Skip navigation EPAM

Lead Software Engineer (Big Data) Chengdu, China

  • hot

Lead Software Engineer (Big Data) Description

Job #: 62820
EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that deliver the most creative and cutting-edge solutions, and have an opportunity to continuously learn and grow. No matter where you are located, you will join a dedicated, creative, and diverse community that will help you discover your fullest potential.


We are looking for an experienced Lead Software Engineer (specializing in Big Data) in Chengdu to make the team stronger.


  • Fulfil the roles of key developer and software architect, and usually also roles of a development team lead, project coordinator, reviewer or auditor as well
  • Be a role model for colleagues, e.g. create high quality deliverables and technical documentation
  • Be in charge of backlog creation, design development of end to end pipelines of data loading, create data schema validation checks
  • Understand, follow and enhance defined software development process and introduce engineering practices
  • Provide input on, follow and evangelize code quality guidelines and standards, assist other developers and conduct code reviews
  • Develops proposals for implementation and designs scalable Big Data architecture
  • Participate in customer’s workshops and present designed solutions
  • Design, implement, and deploy high-performance, custom applications at scale on Cloud
  • Define and develop network infrastructure solutions to enable partners and clients to scale Big Data architecture for growing demands and traffic
  • Define common business and development processes, platform and tools usage for data acquisition, storage, transformation, and analysis
  • Develop roadmaps and implementation strategy around data science initiatives including recommendation engines, predictive modeling, and machine learning
  • Perform reviews and audits of existing solution, design and system architecture
  • Perform profiling, troubleshooting of existing solutions
  • Create technical documentation
  • Lead the strategic planning, development and implementation of medium-to-large Big Data solutions or a component of a larger solution. Lead on all stages of presales activities for such projects. Works on architectural POCs, where required
  • Interact with clients, advise and lead the translation of business requirements and models into appropriate architectural designs to ensure that business needs are met


  • Bachelor's degree or above in Computer Science, Software Engineering or related majors
  • Minimum 7 years of relevant development experience
  • Minimum 2 years of experience with at least 3 major big data technologies and frameworks including but not limited to Spark/Databricks, Sreamsets, AWS S3, Glue, and Redshift to create end to end pipelines
  • Minimum 1 year as Solution Architect, doing solution architecture design and architecture review for small-to-medium size solutions with business use-cases based on familiar technology stack
  • Good understanding of data modelling and able to design with standards
  • Able to translate functional and non-functional requirements into development tasks and architecture design
  • Strong knowledge of at least one programming language such as Scala, Python
  • Expert in designing high quality solutions using OOP, TDD/BDD, Design Patterns and SOLID principles
  • Excellent interpersonal skills, analytical mind, conscientious attitude, and passion for engineering excellence
  • Mandarin speaker, upper intermediate (CEFR B2) or higher level of spoken and written English
  • Good communication and presentation skills
  • Self-management and strong prioritization skills
  • Understanding of code quality measurements and able to implement efficient Unit Tests
  • In depth understanding of different phases of software development lifecycle and understanding of Agile Scrum processes
  • Ability to analyze and evaluate engineering problems in order to find the best possible solution
  • Willingness to adapt to changing requirements and ability to prioritize accordingly
  • Possess strong SQL knowledge and general knowledge of data management
  • Practical expertise in performance tuning and optimization, bottleneck problems analysis
  • Demonstrated experience in solution cost estimation (including tools, tasks, complexity, labor & time) at coarse grain levels, with supporting material evidence
  • Ability to work with Linux console and write bash/shell scrips
  • Ability to provide technical solutions from an architect perspective
  • Ability to provide realistic estimation on required effort and manage to complete tasks in accordance with estimation

Nice to have

  • Experience with big data solutions developed in large cloud computing infrastructures such as Amazon Web Services, Microsoft Azure or Google Cloud
  • Experience in design of one or more of the following: Master Data Management, Data Governance, Advanced Analytics / Data Science, Big Data solutions
  • Certification in Big Data field (i.e. one of Spark, Databricks)
  • Data Science and Analytics experience is a plus (Machine Learning, Recommendation Engines, Search Personalization)
  • Knowledge of one additional programming language as Java, Scala, R, Python or C#
  • Ability to analyze and propose to customer cross-industry or cross-platform solutions
  • Runs technology community or technical talks series

We offer

  • Experience exchange with colleagues all around the world
  • International projects
  • Opportunities for self-realization
  • Friendly team and enjoyable working environment
  • Engineering, corporate and social events
  • Professional & soft skills trainings, medical & family care programs, and forums to explore beyond work passion (CSR, photography, painting, sports, etc.)
  • Free English classes
  • Online training course library, mentoring, career development and potential partial grant of certification
  • Flexible working schedule
  • Compensation for sick leave and paid time off
  • Tech talks and hackathons
  • Referral bonuses

Dobrý den! Jak vám můžeme pomoci?

Kde nás najdete