Cloud Data Integration Engineer
1 week ago
We are seeking a talented and experienced Data Engineer with 3 -5 years experience to join our team, focusing on building and optimizing our data pipelines and architecture. The ideal candidate will be a hands-on contributor with a strong background in real-time data processing, modern data warehousing, and robust database design.Key Responsibilities● Design, develop, and maintain scalable, high-performance ETL/ELT pipelines for both batch and real-time data processing.● Implement and manage data solutions using Apache Flink for stream processing and low-latency data ingestion.● Work extensively with Snowflake to manage and optimize our cloud data warehouse environment, focusing on cost-efficiency and query performance.● Develop robust data models and schemas within StarRocks DB and other analytical stores to support business intelligence and reporting needs. ● Write clean, efficient, and well-tested code, primarily in Java, for data transformation and integration services.● Ensure data quality, integrity, and compliance across all data assets.● Collaborate with data scientists and analysts to implement and optimize models, including those related to statistical modeling and sampling.● Monitor, troubleshoot, and optimize the data platform infrastructure and tools.Education & Experience● Experience: 3 - 5 years of professional experience in a Data Engineering, Software Engineering, or similar role.● Academic: Bachelor of Engineering or Master of Computer Applications in Computer Science, Information Technology, or a related quantitative field.Core Technical Skills● Stream Processing: Deep expertise in Apache Flink (or similar technologies like Apache Kafka Streams/Spark Streaming).● Programming: Strong proficiency in Java. Python is a significant plus.● Data Warehousing: Hands-on experience with cloud data warehouses, specifically Snowflake.● Databases: Expertise in analytical databases like StarRocks DB and strong familiarity with traditional relational (e.G., PostgreSQL, MySQL) and NoSQL databases.● Data Fundamentals: Strong understanding of Data Engineering principles, including data modeling (e.G., Dimensional Modeling, Data Vault), schema design, and data governance.Desired Skills and Tools● Cloud Platforms: Experience with major cloud providers (AWS, Azure, or GCP) services relevant to data (e.G., S3/ADLS/GCS, EMR/Dataproc, Lambda/Cloud Functions).● Data Orchestration: Proficiency with workflow management tools like Apache Airflow or similar (e.G., Dagster, Prefect).Big Data Ecosystem: Familiarity with the broader Apache ecosystem, particularly Apache Kafka for message queuing and Apache Spark (batch processing).● Containerization: Working knowledge of Docker and Kubernetes for deploying and managing data services.● DataOps/DevOps: Experience with CI/CD practices and tools (e.G., Git, Jenkins) applied to data pipelines.● Data Governance & Quality: Understanding of tools and methods for metadata management, lineage tracking, and automated data quality checks (e.G., Great Expectations).● Other Skillsets: Practical application of statistical modeling and sampling techniques in a data pipeline context.
-
Cloud/Snowflake Support Engineer
2 weeks ago
Bengaluru, Karnataka, India Data Engineer Academy Full time US$ 60,000 - US$ 1,20,000 per yearWe're Hiring:Cloud/Snowflake Support Engineer( SME Coach)Remote | Full Time | 7AM EST to 3PM EST| Pay: $ /MonthlyAbout the OpportunityThis role is a blend of a Subject Matter Expert (SME) and support engineer. The primary responsibility is to clear project issues for students while working on multiple projects involving AWS, Snowflake, and dbt. The engineer...
-
Data Engineering Subject Matter Expert
2 weeks ago
Bengaluru, India Data Engineer Academy Full timeWe're Hiring: Data Engineering Subject Matter Expert (SME) – Snowflake,Cloud & Databricks Remote | Part Time | Flexible Timings | Pay: $600 – $1000/MonthlyAbout the OpportunityWe are seeking a highly experienced SME with extensive expertise in Snowflake, Databricks, and AWS cloud platforms.What We're Looking ForMinimum 9-15 years of experience in...
-
Data Engineering Subject Matter Expert
2 weeks ago
Bengaluru, India Data Engineer Academy Full timeWe're Hiring: Data Engineering Subject Matter Expert (SME) – Snowflake,Cloud & DatabricksRemote | Part Time | Flexible Timings | Pay: $600 – $1000/MonthlyAbout the OpportunityWe are seeking a highly experienced SME with extensive expertise in Snowflake, Databricks, and AWS cloud platforms.What We're Looking ForMinimum 9-15 years of experience in cloud...
-
Data Engineering Subject Matter Expert
2 weeks ago
Bengaluru, India Data Engineer Academy Full timeWe're Hiring: Data Engineering Subject Matter Expert (SME) – Snowflake,Cloud & DatabricksRemote | Part Time | Flexible Timings | Pay: $600 – $1000/MonthlyAbout the OpportunityWe are seeking a highly experienced SME with extensive expertise in Snowflake, Databricks, and AWS cloud platforms.What We're Looking ForMinimum 9-15 years of experience in cloud...
-
Data Engineering Subject Matter Expert
2 weeks ago
Bengaluru, India Data Engineer Academy Full timeWe're Hiring: Data Engineering Subject Matter Expert (SME) – Snowflake,Cloud & DatabricksRemote | Part Time | Flexible Timings | Pay: $600 – $1000/MonthlyAbout the OpportunityWe are seeking a highly experienced SME with extensive expertise in Snowflake, Databricks, and AWS cloud platforms.What We're Looking For- Minimum 9-15 years of experience in cloud...
-
Data Engineering Subject Matter Expert
2 weeks ago
Bengaluru, India Data Engineer Academy Full timeWe're Hiring: Data Engineering Subject Matter Expert (SME) – Snowflake,Cloud & DatabricksRemote | Part Time | Flexible Timings | Pay: $600 – $1000/MonthlyAbout the OpportunityWe are seeking a highly experienced SME with extensive expertise in Snowflake, Databricks, and AWS cloud platforms.What We're Looking ForMinimum 9-15 years of experience in cloud...
-
Data Engineering Subject Matter Expert
2 weeks ago
Bengaluru, India Data Engineer Academy Full timeWe're Hiring: Data Engineering Subject Matter Expert (SME) – Snowflake,Cloud & DatabricksRemote | Part Time | Flexible Timings | Pay: $600 – $1000/MonthlyAbout the OpportunityWe are seeking a highly experienced SME with extensive expertise in Snowflake, Databricks, and AWS cloud platforms.What We're Looking ForMinimum 9-15 years of experience in cloud...
-
Data Engineering Subject Matter Expert
2 weeks ago
Bengaluru, India Data Engineer Academy Full timeWe're Hiring: Data Engineering Subject Matter Expert (SME) – Snowflake,Cloud & Databricks Remote | Part Time | Flexible Timings | Pay: $600 – $1000/Monthly About the Opportunity We are seeking a highly experienced SME with extensive expertise in Snowflake, Databricks, and AWS cloud platforms. What We're Looking For - Minimum 9-15 years of experience in...
-
Data Engineering Subject Matter Expert
2 weeks ago
Bengaluru, India Data Engineer Academy Full timeWe're Hiring: Data Engineering Subject Matter Expert (SME) – Snowflake,Cloud & Databricks Remote | Part Time | Flexible Timings | Pay: $600 – $1000/Monthly About the Opportunity We are seeking a highly experienced SME with extensive expertise in Snowflake, Databricks, and AWS cloud platforms. What We're Looking For Minimum 9-15 years of experience in...
-
Data Engineering Subject Matter Expert
2 weeks ago
Bengaluru, India Data Engineer Academy Full timeWe're Hiring: Data Engineering Subject Matter Expert (SME) – Snowflake,Cloud & Databricks Remote | Part Time | Flexible Timings | Pay: $600 – $1000/Monthly About the Opportunity We are seeking a highly experienced SME with extensive expertise in Snowflake, Databricks, and AWS cloud platforms. What We're Looking For Minimum 9-15 years of experience in...