Data Engineer

Overview: The Data Engineer playing a foundational role in the creation and maintenance of robust and scalable data platform and product within data foundation ecosystem. This role required seasoned hands-on experience of big data development, blended with expertise of full-stack engineering. 

Key Responsibilities

• Promote the full life cycle management of data products under the agile development framework, balance business requirements with technical feasibility, and maximize the value of data assets. 

• Responsible for the design and implementation of end-to-end data solutions, covering complex data integration, model optimization, data product development, performance enhancement, etc. 

• Maintaining high standards of data quality followed by the principles defined by governance. 

• Promptly response to any on-demand data service requests from business end-users. 

• Responsible for promptly troubleshooting and effectively resolving any issues that may arise in relation to the data pipelines or the inherent data quality within them.  

• Promote a culture of continuous improvement, innovation, and operational excellence through Agile/Scrum practices.   

• Evaluate and adopt cutting-edge technologies, including open-source tools, to solve complex business problems.   

• Implement security best practices and compliance standards across the product lifecycle.   

Qualifications

• Bachelor’s degree or above in Computer Science, Engineering, or a related field.  

• Fluent experience (typically 5+ years) in data engineering or full stack roles. 

• Proven track record of successfully building, deploying and operating complex data platforms and data products. 

• Strong technical proficiency in big data ecosystem (e.g., Hadoop, Kafka, StarRocks, Spark, Hive etc.) or full-stack programming (e.g., Python, Java, Node.js etc.).   

• Familiar with cloud platforms (AWS/Azure/Tencent), distributed system design, Kubernetes, and microservices architecture.   

• Familiar with agile development processes and able to use Jira for task scheduling. 

• Excellent cross-team communication skills, able to transform complex technical problems into business-understandable solutions. 

• Highly organized, detail-oriented, and able to work in a dynamic and fast-paced environment. 

• Commitment to continuous learning, able to demonstrate familiarity with current trends. 

• Solid understanding of data governance principles, data security best practices, and data quality management.