Pyspark

6 days ago

Bengaluru Karnataka, India Virtusa Full time

Key Responsibilities:
Lead and execute data migration initiatives, specifically from Oracle to PostgreSQL.
Design, develop, and implement AWS DMS solutions to migrate databases.
Collaborate with cross-functional teams to understand data requirements and ensure smooth migration processes.
Develop and optimize data pipelines using Python and PySpark.
Troubleshoot migration issues and implement corrective actions to ensure mínimal disruptions during data transfer.
Ensure data integrity, accuracy, and quality throughout the migration process.
Create and maintain detailed documentation for migration processes, workflows, and data transformations.
Stay up to date with the latest technologies, best practices, and tools in data engineering and migration.
**Requirements**:
5+ years of experience in the IT Industry, with a focus on Data Engineering.
Strong hands-on experience with Oracle to PostgreSQL migrations.
Expertise in using AWS DMS (Database Migration Service) for seamless data migration.
Proficient in Python and PySpark, with a strong understanding of data engineering concepts and data pipeline development.
Solid understanding of database architecture, SQL, and data modeling.
Experience in troubleshooting, optimizing, and scaling data migration workflows.
Ability to work independently and in a team environment with strong problem-solving skills.
Excellent written and verbal communication skills.
Preferred Qualifications:
Experience with other AWS services such as AWS Lambda, S3, and Redshift is a plus.
Familiarity with other database migration tools and technologies.
Certifications in AWS or other relevant data engineering domains.

**About Virtusa**

Teamwork, quality of life, professional and personal development: values that Virtusa is proud to embody. When you join us, you join a team of 27,000 people globally that cares about your growth — one that seeks to provide you with exciting projects, opportunities and work with state of the art technologies throughout your career with us.

Great minds, great potential: it all comes together at Virtusa. We value collaboration and the team environment of our company, and seek to provide great minds with a dynamic place to nurture new ideas and foster excellence.

Virtusa was founded on principles of equal opportunity for all, and so does not discriminate on the basis of race, religion, color, sex, gender identity, sexual orientation, age, non-disqualifying physical or mental disability, national origin, veteran status or any other basis covered by appropriate law. All employment is decided on the basis of qualifications, merit, and business need.

  • Pyspark-gurgaon

    1 week ago

    Bengaluru, Karnataka, India Cognizant Full time

    **Skill**: Pyspark **Experience**: 5 to 14 years **Location**: Gurgaon **Drive Date: 1st Feb 25 (In-Person)** - Design, develop, maintain efficient and scalable solutions using PySpark - Ensure data quality and integrity by implementing robust testing, validation and cleansing processes - Integrate data from various sources, including databases, APIs,...

  • Pyspark

    2 days ago

    Bengaluru, India Riverforest Connections Full time

    Position Purpose - For the projects which are implemented on Data SSC platform, we need senior developer for python - pyspark development to migrate project from spark/scala to python-pyspark._ **Responsibilities** **Direct Responsibilities** Design high quality deliverables adhering to business requirement with defined standards and design principles,...

  • Pyspark

    6 days ago

    Bengaluru, Karnataka, India Hero Moto Corp Full time

    » **Date**:14 Jul 2025 **Location**: Bengaluru, KA, IN, 560038 **Company**:Hero Motocorp **Function** - Digital & Information Technologies **Pay Band** - E4 to M2 **Role** - PySpark, Glue or Databricks developer proficient in cloud technologies who can become a member of HMCL Digital Connected core tech team. The role demands amazing ETL coding skills...

  • Pyspark Developer

    5 days ago

    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    Greetings from TCS!!TCS is hiring for Pyspark DeveloperRequired Skill Set: Pyspark, Python, SQL and relational databases, SparkSQL, Spark Scripting, UNIX Shell Scripting, ETL, Data Warehousing, CI/CDDesired Experience Range: 4 to 10 YearsJob Location: Hyderabad, Bangalore, Chennai, Kolkata, PuneMust Have:Data Engineer, Python developer with specialty in...

  • Azure Databricks with Pyspark

    2 weeks ago

    Bengaluru, Karnataka, India BirlaSoft Full time

    Country/Region: IN - Requisition ID: 25277 - Work Model: - Position Type: - Salary Range: - Location: INDIA - BENGALURU - HP **Title**:Azure Databricks with Pyspark**: - Description: **Area(s) of responsibility**: Birlasoft, a global leader at the forefront of Cloud, AI, and Digital technologies, seamlessly blends domain expertise with enterprise...

  • Pyspark, Python, SQL

    6 days ago

    Bengaluru, Karnataka, India Black & White Business Solutions Full time

    **Job Information**: Industry **IT Services*** Province **Karnataka*** City **Bangalore North*** Postal Code **560001*** Country **India*** Apache Pyspark, python, sql JD: Key Skills/Experience: SQL, Python and Pyspark are required with AWS Cloud exposure preferable - Working experience and strong knowledge in Databricks.Knowledge in Cloud...

  • Pyspark Professional

    2 weeks ago

    Bengaluru, Karnataka, India IDESLABS PRIVATE LIMITED Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Immediate Openings onPyspark Experience : 5+ Skill:-Pyspark Location :- Bangalore Notice Period :- Immediate. PysparkExperience in Cloud platform, e.g., AWS, GCP, Azure, etc.Experience in distributed technology tools, viz. SQL, Spark, Python, PySpark, ScalaPerformance Turing Optimize SQL, PySpark for performanceAirflow workflow scheduling tool for...

  • Pyspark designer

    5 days ago

    Bengaluru, Karnataka, India, Karnataka Tata Consultancy Services Full time

    We are looking for an experienced PySpark AWS Cloud Designer/Developer with a strong background in data integration and ETL. The ideal candidate will have: - Over 5 years’ experience designing and developing ETL integration patterns using Python and Spark. - 3+ years working with PySpark for data processing (Databricks or Apache Spark experience is a...

  • Pyspark Developer

    1 week ago

    Bengaluru, India Tata Consultancy Services Full time

    Greetings from TCS!!TCS is hiring for Pyspark DeveloperRequired Skill Set: Pyspark, Python, SQL and relational databases, SparkSQL, Spark Scripting, UNIX Shell Scripting, ETL, Data Warehousing, CI/CDDesired Experience Range: 4 to 10 YearsJob Location: Hyderabad, Bangalore, Chennai, Kolkata, PuneMust Have:Data Engineer, Python developer with specialty in...

  • Pyspark Developer

    6 days ago

    Bengaluru, India Tata Consultancy Services Full time

    Greetings from TCS!!TCS is hiring for Pyspark DeveloperRequired Skill Set: Pyspark, Python, SQL and relational databases, SparkSQL, Spark Scripting, UNIX Shell Scripting, ETL, Data Warehousing, CI/CDDesired Experience Range: 4 to 10 YearsJob Location: Hyderabad, Bangalore, Chennai, Kolkata, PuneMust Have:Data Engineer, Python developer with specialty in...