Senior Data Engineer - IC
- Kowloon Bay, Hong Kong
- $40,000 per month
- Permanent
- Full-time
- Build up best in class data infrastructure, data engineering solutions.
- Work with cross-functional teams within the organization of different countries, and working with PB size of data, by using modern data technologies (AWS, Databricks, Confluent Kafka, dbt, etc.).
- Leverage industry best practices to build highly flexible, scalable and cost-effective data pipelines and platforms.
- Manage data lakehouse architecture and self-service tools. Ensure that data is highly available and reusable for enabling data science initiatives, analytics and end users to drive business growth.
- Develop efficient clean code, improve existing code for better performance, code review, execute code builds to test and production environments.
- Manage and lead several data projects.
- To be successful in your new position, it is essential to have the following skills:
- Degree in Computer Science, Information System, Actuarial or related discipline.
- At least 5 years of working experience in data warehouse, ETL, BI, Big data areas and broad exposure to all its sub-disciplines.
- Strong in SQL, Python/Scala.
- Experience working with large, complex and multiple data sets from various sources.
- Expert in data architecture, data modelling and design, data pipeline and data integration.
- Hands-on experience in using big data components such as Hive, Spark, Presto, Python and Airflow.
- Experience in AWS (EC2, S3, Kinesis/Kafka, Athena, Redshift), Google Cloud or other Public cloud environments is a must.
- Experience leading a small team of data engineers is a plus.
- Working experience in the digital, e-commerce industry, mobile app and web environment is highly desirable.