Data Scientists
What Cheer, IA
Full-time
Remote
1 month ago
About the role
Job Description
Lead : 10 years experience in Insurance and Healthcare domain
Senior Data Engineer : 6-8 years experience in Insurance and Healthcare domain
Date Engineer : 4 -5 Years experience in Insurance and Healthcare domain
For our Client in Singapore | Work From Home Option | Exciting Career| Immediate Joiner
Cloud Data Engineer, you will be responsible for designing, building, and maintaining scalable and reliable data pipelines on cloud infrastructure. You will work closely with cross-functional teams to implement data storage, processing, and analytics solutions, ensuring high performance, security, and availability. The ideal candidate has a strong background in cloud technologies, data engineering, and a passion for driving innovation through scalable data platforms.
Responsibilities
Qualifications
Lead : 10 years experience in Insurance and Healthcare domain
Senior Data Engineer : 6-8 years experience in Insurance and Healthcare domain
Date Engineer : 4 -5 Years experience in Insurance and Healthcare domain
For our Client in Singapore | Work From Home Option | Exciting Career| Immediate Joiner
Cloud Data Engineer, you will be responsible for designing, building, and maintaining scalable and reliable data pipelines on cloud infrastructure. You will work closely with cross-functional teams to implement data storage, processing, and analytics solutions, ensuring high performance, security, and availability. The ideal candidate has a strong background in cloud technologies, data engineering, and a passion for driving innovation through scalable data platforms.
Responsibilities
- Design, implement, and maintain cloud-based data pipelines to enable efficient storage, processing, and analysis of large volumes of data.
- Collaborate with data engineers, and other stakeholders to understand requirements and translate them into scalable and reliable data platform architectures.
- Evaluate and select appropriate cloud infrastructure and services to support data storage, processing, and analytics needs, considering factors such as scalability, performance, cost, and security.
- Implement data ingestion pipelines, integrating various data sources and ensuring data quality, integrity, and timeliness.
- Design and optimize data storage solutions, including data lakes, data warehouses, and data marts, to support different types of data processing and analysis.
- Implement data processing workflows using technologies such as Apache Spark, Apache Hadoop, or cloud-native data processing services.
- Develop and maintain data governance and security policies, ensuring compliance with data protection regulations and industry best practices.
- Monitor and optimize the performance of data platforms, identifying bottlenecks and implementing optimizations to improve data processing speed and efficiency.
- Collaborate with DevOps teams to automate deployment, monitoring, and management of data platforms using infrastructure-as-code and CI/CD practices.
- Stay up-to-date with emerging technologies and industry trends in cloud computing, big data processing, and data engineering.
- Provide guidance and mentorship to junior team members, fostering a culture of learning and innovation.
Qualifications
- Bachelor's or Master's degree in computer science, engineering, or a related field.
- Proven experience as a Data Engineer, Software Engineer, or similar role, with a focus on building cloud-based data platforms.
- Strong experience in cloud computing platforms such as Microsoft Azure
- Proficiency in the latest Big Data tools/technologies like Hive, Hadoop, Yarn, Kafka, Spark Stream.
- Proficiency in data processing frameworks such as Apache Spark, Apache Hadoop, or cloud-native data processing services (Azure Data Lake, Azure Data factory, Azure Databricks, Azure Synapse, Snowflake,CosmosDB)
- Experience with data integration and ETL (Extract, Transform, Load) processes, including tools like Apache Airflow or cloud-native orchestration services.
- Experience with workload and job optimization for cost reduction
- Knowledge of database systems (relational and NoSQL) and data modeling principles.
- Familiarity with data governance, data security, and compliance frameworks.
- Understanding of distributed computing principles and scalable architectures.
- Experience with infrastructure-as-code tools like Terraform
- Excellent problem-solving and troubleshooting skills, with the ability to address complex data platform challenges.
- Strong communication and collaboration skills to work effectively with cross-functional teams.
Skills
Software Development