Senior ETL Developer

1 day ago

Remote, India INFOSEUM IT OPC PVT LTD Full time ₹ 9,86,000 - ₹ 12,21,868 per year

Job Title: ETL Automation Tester (Databricks, PySpark, Delta Lake)

Job Summary:

We're looking for an experienced Data Pipeline Test Engineer to join our team. The successful candidate will have strong expertise in Databricks, PySpark, Delta Lake, and ETL testing, with a focus on automation and data integrity. You'll design, develop, and execute test plans for data pipelines, ensuring data accuracy, completeness, and integrity at every stage.

Key Responsibilities:

  • Design, develop, and execute test plans for data pipelines using Databricks, PySpark, and Delta Lake.
  • Validate data accuracy, completeness, and integrity at every stage of the pipeline.
  • Develop and maintain automated test frameworks and scripts using Python and SQL.
  • Collaborate with data engineers and analysts to identify testing requirements and ensure data quality.
  • Troubleshoot and debug issues with data pipelines and testing frameworks.
  • Stay up to date with new technologies and features in Databricks, PySpark, and Delta Lake.

Required Skills:

  • Strong SQL skills (window functions, joins, aggregates).
  • Proficiency in PySpark (Data Frame APIs, UDFs, Structured Streaming).
  • Delta Lake fundamentals: ACID, time travel, schema enforcement/evolution, Change Data Capture (CDC).
  • Databricks Lakehouse concepts: medallion architecture (Bronze/Silver/Gold), Photon, serverless vs classic clusters.
  • Hands-on experience with Databricks platform, including notebooks, Jobs, and DLT pipelines.
  • Extensive experience with ETL (Extract, Transform, Load) and ELT processes.
  • Test automation experience with Python and SQL.
  • Strong analytical and problem-solving skills.
  • Excellent communication and collaboration skills.

Preferred to Have:

  • Experience with data warehousing and big data technologies.
  • Familiarity with Agile development methodologies.
  • Knowledge of data governance and data quality frameworks.

What We Offer:

  • Competitive salary and benefits package.
  • Opportunity to work with cutting-edge technologies and innovative teams.
  • Collaborative and dynamic work environment.
  • Professional growth and development opportunities.

Job Types: Full-time, Permanent

Pay: ₹986, ₹1,221,868.47 per year

Benefits:

  • Flexible schedule
  • Leave encashment
  • Paid sick time
  • Paid time off
  • Provident Fund
  • Work from home

Work Location: Remote

  • Senior ETL Developer

    7 days ago

    Remote, India Whiz IT services Pvt Ltd Full time ₹ 6,00,000 - ₹ 9,00,000 per year

    Job Title: ETL DeveloperCompany: Whiz IT Services Pvt. Ltd.Location: 91Springboard, Creaticity Mall, Shastrinagar, Yerawada, Pune, Maharashtra 411006Job Type: HybridExperience: Minimum 3 years in ETL Development (Pentaho Kettle & SQL)Salary: NegotiableNo. of Vacancies: 01Job OverviewWe are seeking an experienced ETL Developer with a strong background in...

  • ETL Developer

    21 hours ago

    Remote, India Digital Placement Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    ETL DeveloperCompany OverviewDigital Placement is a staffing and recruiting company that helps businesses find talented professionals to fill their open positions in various industries. Role and ResponsibilitiesThe ETL Developer will be responsible for various tasks that include automation of the processes process of impact analysis, remediation-related...

  • Etl Admin

    7 days ago

    Remote, India Softsages Technology Full time

    **Description of Duties**: - Implement procedures to maintain, monitor, backup, and recover the ETL environment. - Report regularly on health and performance of ETL environment and jobs. - Perform import and export ETL jobs across various ETL projects and servers. - Conduct ETL optimization, troubleshooting, and debugging. - Perform and assume other duties...

  • ETL/Informatica Developer

    2 weeks ago

    Remote, India AWIGN ENTERPRISES PRIVATE LIMITED Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Role Overview : We are seeking a talented Informatica BDM (Big Data Management) Developer to design, develop, and optimize data integration workflows on modern data platforms. The ideal candidate will have hands-on experience in ETL development, data pipelines, and data lake integrations using Informatica BDM, with a strong understanding of Hadoop or...

  • ETL Developer

    3 days ago

    Remote India Pinnacle Group Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Pinnacle Group exists to connect people with opportunity. For the last 25 years, we've done exactly that by living our core values of putting people first, delivering excellence in all we do, and giving back to the communities in which we live and work. We are a leading workforce solutions company supporting the talent needs of global leaders in financial...

  • Etl Tester

    5 days ago

    Remote, India MindTrilogy IT Solutions Pvt. Ltd Full time

    **ETL Tester(SQL + ETL + SSIS)** **Experience:6 - 10 yrs** **Budget : 120LPM** **Shift: 11:00 am to 8 pm** **Working hours :8 hours per day** **Duration: 6 Months** **Must be ready for BGV/Contact details mandatory** Must-Have Skills 6+ years SQL development and database management experience Test and validate ETL processes using SQL and SSIS for...

  • Actimize and ETL Developer

    2 weeks ago

    Remote, India Matrix Global Full time ₹ 4,00,000 - ₹ 8,00,000 per year

    Position: Actimize and ETL DeveloperOverview: We are seeking a talented Actimize and ETL Developer to join our dynamic development team. The ideal candidate will have a strong background in ETL development, system customization, and implementation, with a keen understanding of compliance-related domains such as Anti-Money Laundering (AML) and Trade...

  • ETL Developer

    5 days ago

    Remote, India Asv Consulting Services Pvt Ltd Full time ₹ 20,00,000 - ₹ 80,00,000 per year

    RequirementsWe are seeking a skilled and experienced Data Integration Specialist with over 5 years of experience in designing and developing data solutions using Oracle Data Integrator (ODI). The ideal candidate will have strong expertise in data modeling, ETL/ELT processes, and SQL, along with exposure to Python scripting for API-based data ingestion.Key...

  • Etl Tester

    2 weeks ago

    Remote, India QBID Infotech Full time

    **Job Title : ETL Tester** **Job Location** - Remote **Shift Time -**11:30 AM - 8:30 PM IST **Required Skills**: - **Hands-on experience with Data Warehouse (EDW) and BI testing**, including tools such as **Power BI, Cognos, and Azure Data Services**. - Proficiency in **ETL testing** - validating data pipelines, data transformations, and ensuring data...

  • Senior ETL Tester

    3 days ago

    Remote, India Etelligens Technologies Pvt. Ltd. Full time ₹ 5,00,000 - ₹ 13,00,000 per year

    Responsibilties:At least 4years testing experience as ETL/Database tester using MS-SQLAble to independently write, execute, tune stored procedures to validate test results based on mapping document.Write strong SQL queries with different join types, T-SQL data structures to assert the test results adhering to mapping documentIndependently work with Business...