Senior ETL Developer – Data Ingestion

6 days ago

Indore, Madhya Pradesh, India Techment Technology Full time ₹ 12,00,000 - ₹ 24,00,000 per year

Job Description

We are seeking a highly skilled and experienced ETL Developer specializing in data ingestion and extraction to join our team. The ideal candidate will have 8–12 years of experience in building and managing scalable ETL pipelines, integrating diverse data sources, and optimizing data workflows for Snowflake. You will collaborate with cross-functional teams to extract, transform, and load large-scale datasets, ensuring data quality, consistency, and performance in a cloud-based data ecosystem.

Roles & Responsibilities

Data Extraction and Ingestion:

Design and implement processes to extract data from various sources such as on-premise databases, cloud storage (S3, GCS), APIs, and third-party applications.

Ensure seamless data ingestion into Snowflake, utilizing tools and techniques like SnowSQL, COPY INTO commands, Snowpipe, and third-party ETL tools (Matillion, Talend, Fivetran).

Develop robust solutions for handling data ingestion challenges, including connectivity issues, schema mismatches, and data format inconsistencies.

Data Transformation and Integration:

Perform complex data transformations within Snowflake using SQL-based ELT methodologies.

Implement incremental loading strategies and track data changes using Change Data Capture (CDC) techniques.

Optimize transformation processes for performance and scalability, leveraging Snowflake's native capabilities such as clustering, materialized views, and UDFs.

Pipeline Development and Maintenance:

Design and maintain ETL pipelines capable of processing terabytes of data efficiently.

Optimize ETL jobs for performance, parallelism, and data compression.

Ensure error logging, retry mechanisms, and real-time monitoring for robust pipeline operation.

Data Quality and Governance:

Implement mechanisms for data validation, integrity checks, duplicate handling, and consistency verification.

Collaborate with stakeholders to ensure adherence to data governance standards and compliance requirements.

Collaboration and Documentation:

Work closely with data engineers, analysts, and business stakeholders to define requirements and deliver high-quality solutions.

Document data workflows, technical designs, and operational procedures.

Performance Optimization:

Bulk data loading best practices: partitioning, parallel processing, compression, and small batch processing.

ETL pipeline optimization for scalability and speed.

Data Transformation:

Proficient in ELT processes and understanding of traditional ETL differences.

Experience with CDC techniques for incremental loading.

Data Quality:

Expertise in data validation, integrity checks, and error handling.

Skills

8–12 years of experience in ETL development and data engineering, with significant experience in Snowflake.

Expertise in Tools and Technologies:

Snowflake: SnowSQL, COPY INTO, Snowpipe, external tables.

ETL Tools: Matillion, Talend, Fivetran, or equivalent.

Cloud Storage: S3, GCS, Azure Blob Storage.

Databases: Oracle, SQL Server, PostgreSQL, MySQL.

APIs: REST, SOAP for data extraction.

Strong SQL Skills: Proficient in writing and optimizing complex SQL queries.

Soft Skills: Strong analytical thinking, problem-solving abilities, and excellent communication skills.

Experience

8-12 Years

Location: Bhilai, Indore

  • ETL Developer

    7 days ago

    Indore, Madhya Pradesh, India Infobyd software solution pvt ltd Full time ₹ 7,00,000 - ₹ 8,00,000 per year

    Experience: 5–7 YearsLocation: Hybrid (All Locations)Work Timings: 11:00 AM – 9:00 PM ISTRole Overview- We are looking for a highly skilled MSBI ETL Developer with strong hands-on experience in SSIS, Power BI, SQL Server, and Azure Data Factory (ADF). The ideal candidate will have deep expertise in data integration, data warehousing concepts, ETL...

  • Data Engineer

    2 weeks ago

    Indore, Madhya Pradesh, India Nucleusteq Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Data Engineer-ETL (Data Migration & Validation)Role OverviewWe are looking for an ETL Engineer with strong experience in data migration, validation,and transformation to support the large-scale migration of legacy warehouse systems toSnowflake. The candidate will develop ingestion and transformation jobs, perform datareconciliations, and ensure data quality...

  • Senior Data Architect

    6 days ago

    Indore, Madhya Pradesh, India Techment Technology Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job DescriptionWe are looking for a highly skilled and experienced Senior Data Engineer to join our growing data team. This role demands a hands-on expert in data architecture, pipeline development, and cloud-based data solutions. The ideal candidate will have a passion for designing robust and scalable systems, transforming data into actionable insights,...

  • Senior Data Engineering Lead

    1 hour ago

    Indore, Madhya Pradesh, India Ccube Full time ₹ 40,00,000 - ₹ 80,00,000 per year

    Company DescriptionCcube is an IT consulting company specializing in Apps, Data & AI in the Cloud. With expertise in web/mobile app development, data engineering, data architecture, cloud-based DataOps/MLOps, and AI solutions, Ccube provides innovative and scalable technologies. The company delivers turnkey projects and resources across the US and India,...

  • Senior Azure Healthcare Data Platform Engineer

    2 days ago

    Indore, Madhya Pradesh, India Hvantage Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Job Title: Senior Azure Healthcare Data Platform Engineer (FHIR / HDS / HL7)Company: Hvantage Tech Solutions Pvt. Ltd.Location: HybridEmployment Type: Full-Time / ContractExperience Required: Minimum 8+ YearsDomain: Healthcare Information TechnologyAbout Hvantage Tech Solutions Pvt Ltd.Hvantage Tech Solutions Pvt. Ltd. is a global technology solutions...

  • Project-Based Data Platform Engineer

    4 days ago

    Indore, Madhya Pradesh, India KiKeKe Vortexium Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Project-Based Data Platform Engineer (AWS + GCP / S3 + BigQuery)About Kikeke Vortexium TechnologiesKikeke Vortexium Technologies Private Limitedis a technology company based inIndore, India, developing high-performance data and gaming platforms for theCasino Elite Group (Belgium).We are currently expanding ourdata infrastructureto enable advanced analytics,...

  • Senior Data Engineer/Data Architect

    2 weeks ago

    Indore, Madhya Pradesh, India Intertec Softwares Pvt Ltd Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    We are seeking an experienced Presales Solution Architect with deep Microsoft Data Platform & AI expertise, combined with knowledge and exposure to other modern data platforms such as Snowflake, SAAL.AI, Databricks, Synapse, and BigQuery.The ideal candidate will have a proven track record of architecting enterprise-scale data and AI solutions, leading...

  • Node JS Developer

    2 weeks ago

    Indore, Madhya Pradesh, India Developer Bazaar Technologies Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Location: Onsite Type: Full-time Experience: 1-2 yearsAbout the role:As a Backend Developer at DBTech, you'll build the core engine that powers our digital products—secure, scalable, and efficient. From crafting clean APIs to managing databases and deployments, your code will bring ideas to life. You'll work closely with cross-functional teams to solve...

  • Node JS Developer

    2 weeks ago

    Indore, Madhya Pradesh, India Developer Bazaar Technologies Full time ₹ 4,00,000 - ₹ 12,00,000 per year

    Location: Onsite Type: Full-time Experience: 1-2 years About the role:As a Backend Developer at DBTech, you'll build the core engine that powers our digital products—secure, scalable, and efficient. From crafting clean APIs to managing databases and deployments, your code will bring ideas to life. You'll work closely with cross-functional teams to solve...

  • Data Engineer

    7 days ago

    Indore, Madhya Pradesh, India Arna Softech Full time ₹ 4,00,000 - ₹ 12,00,000 per year

    Responsibilities:* Design, develop & maintain data pipelines using Snowflake, Python & Data Bricks* Optimize performance through ETL process improvements* Collaborate with cross-functional teams on project deliveryHealth insuranceProvident fund