Etl Databricks

4 days ago

Pune Maharashtra, India Virtusa Full time

Looking for a offshore Techlead with databricks engineer experience and lead the team from offshore.
Develop and maintain a metadata driven generic ETL framework for automating ETL code
Design, build, and optimize ETL/ELT pipelines using Databricks (PySpark/SQL) on AWS.
Ingest data from a variety of structured and unstructured sources (APIs, RDBMS, flat files, streaming).
Develop and maintain robust data pipelines for batch and streaming data using Delta Lake and Spark Structured Streaming.
Implement data quality checks, validations, and logging mechanisms.
Optimize pipeline performance, cost, and reliability.
Collaborate with data analysts, BI, and business teams to deliver fit for purpose datasets.
Support data modeling efforts (star, snowflake schemas) de norm tables approach and assist with data warehousing initiatives.
Work with orchestration tools Databricks Workflows to schedule and monitor pipelines.
Follow best practices for version control, CI/CD, and collaborative development

**Skills**:Hands-on experience in ETL/Data Engineering roles.
Strong expertise in Databricks (PySpark, SQL, Delta Lake), Databricks Data Engineer Certification preferred
Experience with Spark optimization, partitioning, caching, and handling large-scale datasets.
Proficiency in SQL and scripting in Python or Scala.
Solid understanding of data lakehouse/medallion architectures and modern data platforms.
Experience working with cloud storage systems like AWS S3
Familiarity with DevOps practices Git, CI/CD, Terraform, etc.
Strong debugging, troubleshooting, and performance-tuning skills.

**About Virtusa**

Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 27,000 people globally that cares about your growth — one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.

Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.

Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.

  • ETL Consultant

    3 weeks ago

    Pune, India EXL Full time

    We are seeking a detail-oriented ETL cum BI Engineer with strong expertise in Tableau and Databricks to maintain, optimize, and enhance our reporting infrastructure. This role focuses on dashboard upkeep, data flow management, and enabling new analytical capabilities across multiple regions and business units. The ideal candidate will ensure high data...

  • ETL Consultant

    3 weeks ago

    Pune, India EXL Full time

    We are seeking a detail-oriented ETL cum BI Engineer with strong expertise in Tableau and Databricks to maintain, optimize, and enhance our reporting infrastructure. This role focuses on dashboard upkeep, data flow management, and enabling new analytical capabilities across multiple regions and business units. The ideal candidate will ensure high data...

  • ETL Consultant

    3 weeks ago

    Pune, India EXL Full time

    We are seeking a detail-oriented ETL cum BI Engineer with strong expertise in Tableau and Databricks to maintain, optimize, and enhance our reporting infrastructure. This role focuses on dashboard upkeep, data flow management, and enabling new analytical capabilities across multiple regions and business units. The ideal candidate will ensure high data...

  • ETL Consultant

    3 weeks ago

    Pune, India EXL Full time

    We are seeking a detail-oriented ETL cum BI Engineer with strong expertise in Tableau and Databricks to maintain, optimize, and enhance our reporting infrastructure. This role focuses on dashboard upkeep, data flow management, and enabling new analytical capabilities across multiple regions and business units. The ideal candidate will ensure high data...

  • ETL Consultant

    2 weeks ago

    Pune, India EXL Full time

    We are seeking a detail-oriented ETL cum BI Engineer with strong expertise in Tableau and Databricks to maintain, optimize, and enhance our reporting infrastructure. This role focuses on dashboard upkeep, data flow management, and enabling new analytical capabilities across multiple regions and business units. The ideal candidate will ensure high data...

  • ETL Consultant

    3 days ago

    pune, India EXL Full time

    We are seeking a detail-oriented ETL cum BI Engineer with strong expertise in Tableau and Databricks to maintain, optimize, and enhance our reporting infrastructure. This role focuses on dashboard upkeep, data flow management, and enabling new analytical capabilities across multiple regions and business units. The ideal candidate will ensure high data...

  • ETL Consultant

    5 days ago

    pune, India EXL Full time

    We are seeking a detail-oriented ETL cum BI Engineer with strong expertise in Tableau and Databricks to maintain, optimize, and enhance our reporting infrastructure. This role focuses on dashboard upkeep, data flow management, and enabling new analytical capabilities across multiple regions and business units. The ideal candidate will ensure high data...

  • Sr ETL Tester

    6 days ago

    Pune, India Tata Consultancy Services Full time

    Greetings from TCS!TATA Consultancy Services is hiring for Senior ETL Automation TesterDesired experience range: 6 to 12 yearsJob locations: Bangalore, Kolkata, Hyderabad, Chenai, PuneRequired Technical Skill Set:Strong SQL skills, Pyspark or Python automation experience, Experience working with DevOps engineers to integrate automated tests into CI/CD,...

  • Sr ETL Tester

    7 days ago

    Pune, India Tata Consultancy Services Full time

    Greetings from TCS!TATA Consultancy Services is hiring for Senior ETL Automation TesterDesired experience range: 6 to 12 yearsJob locations: Bangalore, Kolkata, Hyderabad, Chenai, PuneRequired Technical Skill Set:Strong SQL skills, Pyspark or Python automation experience, Experience working with DevOps engineers to integrate automated tests into CI/CD,...

  • Sr ETL Tester

    7 days ago

    Pune, India Tata Consultancy Services Full time

    Greetings from TCS!TATA Consultancy Services is hiring for Senior ETL Automation TesterDesired experience range: 6 to 12 yearsJob locations: Bangalore, Kolkata, Hyderabad, Chenai, PuneRequired Technical Skill Set:Strong SQL skills, Pyspark or Python automation experience, Experience working with DevOps engineers to integrate automated tests into CI/CD,...