Senior / Software Engineer (Big Data) Singapore, Singapore
Senior / Software Engineer (Big Data) Description
Job #: 57563DESCRIPTION
We are looking for an experienced Senior / Software Engineer specialized in Big Data in Singapore to make the team stronger.
Responsibilities
- Play a developer role
- Write high quality and testable code following clean code principles
- Implement functionality by following defined software development process without direct supervision
- Read and understand project and requirement documentation
- Create documentation describing his/her code
- Participate in Agile Scrum activities: daily standup, demo session, retrospective, planning, etc
Requirements
- Polytechnic Diploma or above in Computer Science
- Minimum 3 years of experience in software engineering and Big Data
- Advanced knowledge at least one programming language such as Java, Python, Scala
- Familiar with SQL, Bash
- Experienced in any of big data technologies and frameworks below:
- Spark, Spark Streaming, Kafka/ Kafka Streams, Hadoop, Yarn, HDFS, Hive, Airflow, Jupyter
- Parquet, ORC, AVRO, CarbonData
- Lambda, Kappa, Data Lake
- NoSQL Data Bases
- Data platform
- Machine learning
- Software Professional with experience in IT mostly with JVM based technologies and frameworks
- Has background with different platforms and strong focus on back-ends / Big Data / Analytics Solutions
- Core professional expertise includes: Platform Architecture, Data Pipelines Architecture, Infrastructure Deployment and Management
- Able to support existing and potential customers with requirements capture, solutions architecture, system design, solution prototyping
- Experience with building traditional Cloud Data Warehouses, Data Lakes. Close and intensive work on previous projects with Containers and Resource Management systems: Docker, Kubernetes, Yarn
- Designed, prototype and adjust end to end solution
- Designed and implemented set of ingestion workflow to parse, transform and validate input data
- Designed and developed independent CI/CD pipelines
- Provided technical guidance for the support team
- Participated in communication with customer on every phase
We offer
- Friendly team and enjoyable working environment
- Work-life balance and flexible schedule
- Online training library, mentoring, career development and potential partial grant of certification
- Unlimited access to LinkedIn learning solutions
- Referral bonuses
- Compensation for sick leave and paid time off
- Opportunities for self-realization