Etl Pyspark

2 weeks ago

Pune Maharashtra, India Virtusa Full time

Responsible for designing, developing, and maintaining ETL processes to support data integration and business intelligence initiatives. Need to closely work with stakeholders to understand data requirements and ensure efficient data flow and transformation using ETL tools and PySpark

Develop and implement ETL processes using with one of ETL tool and PySpark to extract, transform, and load data.
4+ years of experience in ETL development with knowledge on Pyspark

**About Virtusa**

Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 30,000 people globally that cares about your growth — one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.

Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.

Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.

  • Pyspark

    5 days ago

    Pune, Maharashtra, India Cognizant Full time

    **Skills - Pyspark** **Experience: 6 to 9 years** **Location: AIA-Pune** **Responsibilities** - Develop and maintain scalable data pipelines using Python and PySpark. - Collaborate with data engineers and data scientists to understand and fulfil data processing needs. - Write clean, efficient, and well-documented code following best practices. -...

  • Etl Databricks

    7 days ago

    Pune, Maharashtra, India Virtusa Full time

    Looking for a offshore Techlead with databricks engineer experience and lead the team from offshore. Develop and maintain a metadata driven generic ETL framework for automating ETL code Design, build, and optimize ETL/ELT pipelines using Databricks (PySpark/SQL) on AWS. Ingest data from a variety of structured and unstructured sources (APIs, RDBMS, flat...

  • Databricks Engineer

    1 week ago

    Pune, India Talent Velocity Full time

    Description :Location Pune & NagpurExperience 5-7 YearsEmployment Type Full-Time Job Summary :We are seeking an experienced Data Engineer with strong hands-on expertise in Databricks on any cloud platform (AWS, Azure, or GCP), along with proven skills in SQL, Python, and PySpark. The ideal candidate will have a solid background in database design, data...

  • Business Consulting-Technical analyst with ETL,GCP using Pyspark

    5 days ago

    Pune, Maharashtra, India NTT DATA, Inc. Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    You bring systems design experience with the ability to architect and explain complex systems interactions, data flows, common interfaces and APIs.You bring a deep understanding of and experience with software development and programming languages such as Java/Kotlin, and Shell scripting.You have hands-on experience with the following technologies as a...

  • MarsDevs - AI/ML Engineer - ETL/PySpark

    4 days ago

    Pune, India MarsDevs Full time

    Company Description :MarsDevs is a remote-first, offshore digital product development company, committed to delivering high-quality code and long-lasting technical architectures.We specialize in building MVPs, mobile and web applications, and SaaS products for startups and SMBs.Our services include systematic project analysis, UI/UX design, technical...

  • Pyspark Lead

    2 weeks ago

    Pune, Maharashtra, India Wipro Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Position OverviewWe are seeking a skilled and experienced Senior PySpark Developer with expertise in Apache spark, Spark Batch, and Spark Streaming to join our dynamic team. The ideal candidate will design, develop, and maintain high-performance, scalable applications for processing large-scale data in batch and real-time environments.Required Skills and...

  • Pyspark Developer

    2 weeks ago

    Pune, Maharashtra, India Tech Mahindra Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Pyspark DeveloperRequirements:Mandatory: Primary skill: Pyspark, Data Engineering, Azure Data BricksGood Experience of Hadoop, Hive, and Cloudera/ Azure/GCP 3+ years of experience in the design and implementation of Big Data systems using PySpark, database migration, transformation and integration solutions for any Data warehousing project.Must have...

  • Sr Etl Qa Pyspark

    4 days ago

    Pune, Maharashtra, India virtusa Full time

    Position SummaryThe ETL Tester is responsible for validating and verifying data extraction transformation and loading processes to ensure data accuracy and integrity This role involves designing and executing test cases identifying data quality issues and collaborating with data engineers to resolve discrepancies The ETL Tester will also develop automated...

  • Data Engineer

    4 weeks ago

    Pune, India Tata Consultancy Services Full time

    Job Description – Data Engineer (AWS + PySpark)Location: Pune / Hyderabad / Indore (Onsite)Experience: 4 – 7 YearsJoining: ImmediateRole OverviewWe are seeking a Data Engineer (AWS + PySpark) to join our Team . The role involves designing and building scalable data pipelines, working with large datasets, and enabling advanced analytics on cloud...

  • Data Engineer

    4 weeks ago

    Pune, India Tata Consultancy Services Full time

    Job Description – Data Engineer (AWS + PySpark) Location: Pune / Hyderabad / Indore (Onsite) Experience: 4 – 7 Years Joining: Immediate Role Overview We are seeking a Data Engineer (AWS + PySpark) to join our Team . The role involves designing and building scalable data pipelines, working with large datasets, and enabling advanced analytics on cloud...