Senior ETL Developer

3 days ago

Remote, India INFOSEUM IT OPC PVT LTD Full time ₹ 9,86,000 - ₹ 12,21,868 per year

Job Title: ETL Automation Tester (Databricks, PySpark, Delta Lake)

Job Summary:

We're looking for an experienced Data Pipeline Test Engineer to join our team. The successful candidate will have strong expertise in Databricks, PySpark, Delta Lake, and ETL testing, with a focus on automation and data integrity. You'll design, develop, and execute test plans for data pipelines, ensuring data accuracy, completeness, and integrity at every stage.

Key Responsibilities:

  • Design, develop, and execute test plans for data pipelines using Databricks, PySpark, and Delta Lake.
  • Validate data accuracy, completeness, and integrity at every stage of the pipeline.
  • Develop and maintain automated test frameworks and scripts using Python and SQL.
  • Collaborate with data engineers and analysts to identify testing requirements and ensure data quality.
  • Troubleshoot and debug issues with data pipelines and testing frameworks.
  • Stay up to date with new technologies and features in Databricks, PySpark, and Delta Lake.

Required Skills:

  • Strong SQL skills (window functions, joins, aggregates).
  • Proficiency in PySpark (Data Frame APIs, UDFs, Structured Streaming).
  • Delta Lake fundamentals: ACID, time travel, schema enforcement/evolution, Change Data Capture (CDC).
  • Databricks Lakehouse concepts: medallion architecture (Bronze/Silver/Gold), Photon, serverless vs classic clusters.
  • Hands-on experience with Databricks platform, including notebooks, Jobs, and DLT pipelines.
  • Extensive experience with ETL (Extract, Transform, Load) and ELT processes.
  • Test automation experience with Python and SQL.
  • Strong analytical and problem-solving skills.
  • Excellent communication and collaboration skills.

Preferred to Have:

  • Experience with data warehousing and big data technologies.
  • Familiarity with Agile development methodologies.
  • Knowledge of data governance and data quality frameworks.

What We Offer:

  • Competitive salary and benefits package.
  • Opportunity to work with cutting-edge technologies and innovative teams.
  • Collaborative and dynamic work environment.
  • Professional growth and development opportunities.

Job Types: Full-time, Permanent

Pay: ₹986, ₹1,221,868.47 per year

Benefits:

  • Flexible schedule
  • Leave encashment
  • Paid sick time
  • Paid time off
  • Provident Fund
  • Work from home

Work Location: Remote

  • ETL Developer

    1 day ago

    Remote, India Talent Basket Full time ₹ 18,00,000 - ₹ 20,00,000 per year

    Brief Comment from the client is as below.We are seeking a highly skilled ETL Developer to design, build, and maintain ETL workflows and SQL Server database solutions that support data migration, integration, and analytics initiatives.The ideal candidate will have hands-on expertise with SQL Server (T-SQL, SSIS, SSRS/SSAS), along with a strong background in...

  • Etl Tester

    2 weeks ago

    Remote, India MindTrilogy IT Solutions Pvt. Ltd Full time

    **ETL Tester(SQL + ETL + SSIS)** **Experience:6 - 10 yrs** **Budget : 120LPM** **Shift: 11:00 am to 8 pm** **Working hours :8 hours per day** **Duration: 6 Months** **Must be ready for BGV/Contact details mandatory** Must-Have Skills 6+ years SQL development and database management experience Test and validate ETL processes using SQL and SSIS for...

  • ETL Developer

    7 days ago

    Remote, India Asv Consulting Services Pvt Ltd Full time ₹ 20,00,000 - ₹ 80,00,000 per year

    RequirementsWe are seeking a skilled and experienced Data Integration Specialist with over 5 years of experience in designing and developing data solutions using Oracle Data Integrator (ODI). The ideal candidate will have strong expertise in data modeling, ETL/ELT processes, and SQL, along with exposure to Python scripting for API-based data ingestion.Key...

  • ETL Tester SQL

    1 day ago

    Remote, India Data PlatformExperts Full time ₹ 50,000 - ₹ 10,00,000 per year

    Job Title: ETL Tester (Strong SQL)Experience: 3+ YearsWork Mode: RemoteWork Timings: 4:00 PM – 1:00 AM ISTJoiner: ImmediateJob Description:We are looking for a skilled ETL Tester with strong SQL expertise to join our team. The ideal candidate should have hands-on experience in testing ETL processes, validating data accuracy, and ensuring high-quality data...

  • Etl - Testing

    2 weeks ago

    Remote, India Elfonze Technologies Full time

    **Job Information**: Date Opened - 11/06/2024Job Type - Full timeIndustry - IT ServicesRemote Job This is a remote position. - Design, implement, and continuously expand data pipelines by performing extraction, transformation, and loading activities - Gather requirements and business process knowledge to transform the data in a way that’s geared towards...

  • Etl - Testing

    2 weeks ago

    Remote, India Elfonze Technologies Full time

    **Job Information**: Date Opened - 11/06/2024Job Type - Full timeIndustry - IT ServicesRemote Job This is a remote position. - Job Description - Design, implement, and continuously expand data pipelines by performing extraction, transformation, and loading activities - Gather requirements and business process knowledge to transform the data in a way...

  • Lead-Data Analytics Architect(ETL)

    1 day ago

    Remote, India Accelirate Inc. Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    ETL ArchitectLocation: Pune, India (Hybrid/Remote)Job Type: Full-TimeExperience: 10+ yearsJob Summary:We are seeking an experienced ETL Lead / ETL Architect to design, develop, and optimize scalable data pipelines. This role involves working with ETL tools (e.g. Matillion, Informatica, Talend, SSIS, ADF, AWS Glue etc), cloud data platforms (Snowflake, Azure,...

  • Sr. ETL/BI Consultant

    3 days ago

    Remote, India STATIC PRICE IT SERVICES HYDERABAD PRIVATE LIMITED Full time ₹ 12,00,000 - ₹ 18,00,000 per year

    Position Summary:The Sr. ETL/BI Consultant is responsible for planning, designing, configuring, developing, testing,deploying and supporting ETL/BI solutions. Develops and uses ETL applications to perform data analysis,create technical designs and provide applications support.Responsibilities: Excellent customer facing skills, communications, writing and...

  • Looking for SAP Bods Etl Trainer

    2 days ago

    Remote, India Intellecto Global Services Full time

    We are seeking a talented and experienced SAP BusinessObjects Data Services (BODS) ETL Trainer to join our team. **Job Description**: **Responsibilities**: Develop comprehensive training materials and curriculum for SAP BusinessObjects Data Services (BODS) ETL. Provide hands-on training and guidance on data extraction, transformation, and loading processes...

  • ETL / SQL / Data Engineer

    23 hours ago

    Remote, India ABCO COMPUTERS PVT LTD Full time ₹ 84,000 - ₹ 12,00,000 per year

    QualificationsBachelor's degree in Computer Science, Information Systems, or related field (or equivalent work experience).4+ years of experience as a SQL Developer or Data Engineer.Strong expertise in writing and optimizing SQL queries (complex joins, window functions, performance tuning).Hands-on ETL development experience using any ETL tools . Good to...