01/07/2025 Python Pyspark Data Engineer

4 weeks ago


Bengaluru, Karnataka, India DXC Technology Full time

Python Pyspark Data Engineer Job Location Hyderabad Bangalore Chennai Kolkata Noida Gurgaon Pune Indore Mumbai We are seeking a skilled Lead Data Engineer with strong programming and SQL skills to join our team The ideal candidate will have hands-on experience with Python and Pyspark Data Analytics services and a basic understanding of general AWS services Key Responsibilities Design develop and optimize data pipelines using Python Pyspark AWS Data Analytics services such as RDS DMS Glue Lambda Redshift and Athena Implement data migration and transformation processes using AWS DMS and Glue Work with SQL Oracle Postgres to query manipulate and analyse large datasets Develop and maintain ETL ELT workflows for data ingestion and transformation Utilize AWS services like S3 IAM CloudWatch and VPC to ensure secure and efficient data operations Write clean and efficient Python scripts for automation and data processing Collaborate with DevOps teams using Azure DevOps for CI CD pipelines and infrastructure management Monitor and troubleshoot data workflows to ensure high availability and performance At DXC Technology we believe strong connections and community are key to our success Our work model prioritizes in-person collaboration while offering flexibility to support wellbeing productivity individual work styles and life circumstances We re committed to fostering an inclusive environment where everyone can thrive Recruitment fraud is a scheme in which fictitious job opportunities are offered to job seekers typically through online services such as false websites or through unsolicited emails claiming to be from the company These emails may request recipients to provide personal information or to make payments as part of their illegitimate recruiting process DXC does not make offers of employment via social media networks and DXC never asks for any money or payments from applicants at any point in the recruitment process nor ask a job seeker to purchase IT or other equipment on our behalf More information on employment scams is available



  • Bengaluru, Karnataka, India Nuware Systems LLP Full time

    Job Summary :We are seeking a highly skilled and experienced Data Engineer to join our team. The ideal candidate will have strong hands-on expertise in Python, PySpark, and SQL Server, along with exposure to modern data platforms. You will play a critical role in building, optimizing, and maintaining data pipelines that support business insights and...


  • Bengaluru, Karnataka, India DXC Technology Full time

    Python Pyspark Data Engineer Job Location Hyderabad Bangalore Chennai Kolkata Noida Gurgaon Pune Indore Mumbai Strong Python Skills - Proficient in Python for data manipulation automation and building reusable components Data Pipeline Development - Experience designing and maintaining ETL data pipelines using tools like Airflow or...


  • Bengaluru, Karnataka, India Virtusa Full time

    Job DescriptionSkills Required:Python, PySpark, Azure Databricks, Shell Scripting, DB2, CI/CD (GIT, Jenkins), Java understandingExperience & Requirements- 5+ years of professional Python/PySpark development experience- Strong experience with FastAPI or similar framework (Flask, Django REST)- Deep understanding of REST API design principles- Expertise in...

  • Pyspark Engineer

    5 days ago


    Bengaluru, Karnataka, India Pan Asia HR Solutions Full time

    Job Description : We are looking for a skilled PySpark Developer with expertise in ETL processes, Python, and SQL to design, develop, and optimize large-scale data processing pipelines. The ideal candidate will have hands-on experience in PySpark for data transformation, aggregation, and analysis in a Big Data environment.Key Responsibilities : - Design,...

  • Pyspark Developer

    2 weeks ago


    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Position - Pyspark Developer Experience: 6 to 12 Years Notice Period- 0-60 Days Required Skill Set: Pyspark, Python, SQL and relational databases, SparkSQL, Spark Scripting, UNIX Shell Scripting, ETL, Data Warehousing, CI/CD Job Location: Chennai / Pune / Bangalore / Hyderabad / Gurugram Must Have: Data Engineer, Python developer with specialty in...


  • Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Greetings from TCSTCS is hiring for Big Data (PySpark)Location: - Chennai/BangaloreDesired Experience Range: 3 + YearsMust-Have• PySpark • HiveGood-to-Have• Spark • HBase • DQ tool • Agile Scrum experience • Exposure in data ingestion from disparate sources onto Big Data platformThanksAnshika


  • Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Role ** Data Engineer Required Technical Skill Set ** Python , Pyspark, GCP, BigQuery , Astronomer Desired Experience Range ** 6+ years Location of Requirement Bangalore Desired Competencies (Technical/Behavioral Competency) Must-Have ** (Ideally should not be more than 3-5) · Development, Production Support and delivery of Python, BigQuery, SQL, GCP,...


  • Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Role** Data EngineerRequired Technical Skill Set** Python , Pyspark, GCP, BigQuery , AstronomerDesired Experience Range** 6+ yearsLocation of Requirement BangaloreDesired Competencies (Technical/Behavioral Competency)Must-Have**(Ideally should not bemore than 3-5)· Development, Production Support and delivery of Python, BigQuery, SQL, GCP, Airflow based...

  • Pyspark Developer

    3 weeks ago


    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Greetings from TCSTCS is hiring for Pyspark DeveloperRequired Skill Set: Pyspark, Python, SQL and relational databases, SparkSQL, Spark Scripting, UNIX Shell Scripting, ETL, Data Warehousing, CI/CDDesired Experience Range: 4 to 10 YearsJob Location: Chennai / Pune / Bangalore / Hyderabad / Trivandrum / KochiMust Have:Data Engineer, Python developer with...

  • Pyspark Developer

    4 weeks ago


    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Greetings from TCS TCS is hiring for Pyspark Developer Required Skill Set: Pyspark, Python, SQL and relational databases, SparkSQL, Spark Scripting, UNIX Shell Scripting, ETL, Data Warehousing, CI/CD Desired Experience Range: 4 to 10 Years Job Location: Chennai / Pune / Bangalore / Hyderabad / Trivandrum / Kochi Must Have: Data Engineer, Python...