Data Engineer Python+Pyspark

5 days ago


Bangalore, India Mopid Full time

Data Engineer (Python + PySpark) Position

Experience Range: 2-6 years

Job Timing: This is a full-time position

Job Type: The role is designed as a hybrid work arrangement

We are seeking a skilled Data Engineer with expertise in Python and PySpark to join our dynamic team in Bengaluru. This position is ideal for individuals with 2-6 years of experience in the field, looking to leverage their skills in a hybrid work arrangement. As a Data Engineer, you will play a crucial role in managing our data workflows and pipelines, ensuring data quality and efficiency across the board.

Key Responsibilities:

  • Design, construct, install, test, and maintain highly scalable data management systems.
  • Develop high-performance algorithms, predictive models, and prototypes using Python and PySpark.
  • Ensure that all systems meet the business/company requirements as well as industry practices.
  • Integrate up-and-coming data management and software engineering technologies into existing data structures.
  • Create custom software components and analytics applications.
  • Employ a variety of languages and tools to marry systems together.
  • Recommend ways to improve data reliability, efficiency, and quality.
  • Collaborate with data architects, modelers, and IT team members on project goals.

Required Skills:

  • Proven expertise in Python programming language.
  • Strong proficiency in Apache PySpark for large-scale data processing.
  • Familiarity with SQL database design and multiple programming languages is advantageous.
  • Demonstrated ability to build processes that support data transformation, workload management, data structures, dependency resolution, etc.
  • Adept at working with large datasets in a distributed computing environment.
  • Analytical mind with problem-solving aptitude.

If you are passionate about big data technologies and have the required skill set along with the eagerness to thrive in a fast-paced environment located in Bengaluru; we would love to hear from you. Join us in shaping the future of our company’s data handling capabilities. We look forward to your application



  • bangalore, India Mopid Full time

    Data Engineer (Python + PySpark) Position Experience Range: 2-6 years Job Timing: This is a full-time position Job Type: The role is designed as a hybrid work arrangement We are seeking a skilled Data Engineer with expertise in Python and PySpark to join our dynamic team in Bengaluru. This position is ideal for individuals with 2-6 years of experience in...

  • Data Engineer

    2 months ago


    Bangalore/Hyderabad, Karnataka, India ANRI Solutions HR Services Full time

    Job Description : We are seeking a skilled Data Engineer with 4-8 years of experience to join our dynamic team. The ideal candidate will have a strong background in Python and PySpark, and will be responsible for designing, developing, and maintaining scalable data pipelines and architectures.Responsibilities : - Design and implement data pipelines using...

  • Senior Data Engineer

    1 month ago


    Bangalore, Karnataka, India SKYLARK HR SOLUTIONS Pvt Ltd Full time

    Position : PySpark/Python with AWS Developer. Location : Bangalore. Number of Open Positions : 7. Experience Required : 7-9 Years. Relevant- Experience : 3+ Years.Shift : General Shift. Remote Work : WFH. Notice period : 30 Days. Note WE ARE NOT CONSIDERING CANDIDATES- FROM DATA ANALYST OR DATA SCIENTIST. Role Overview : As a PySpark/Python Developer with...


  • bangalore, India Andor Tech Full time

    Job Title: Python Developer with PySpark Location: Bengaluru (Work from Office) Job Summary: We are looking for a Python Developer with strong PySpark skills to join our data engineering team. The ideal candidate will have a solid foundation in Python programming and experience with PySpark for big data processing. In this role, you will build and maintain...


  • bangalore, India Andor Tech Full time

    Job Title: Python Developer with PySparkLocation: Bengaluru (Work from Office)Job Summary:We are looking for a Python Developer with strong PySpark skills to join our data engineering team. The ideal candidate will have a solid foundation in Python programming and experience with PySpark for big data processing. In this role, you will build and maintain...

  • Data Engineer

    4 weeks ago


    Bangalore/Chennai, India TekPillar Full time

    Job Title : Data EngineerExperience : 3-8 YearsLocation : Chennai / BangaloreJob Type : Full-timeRequire Skills : Data Engineer, AWS, Airflow, PySpark, Hadoop, Big data, Glue, Athena, Lambda, Python Job Description : We are seeking a highly skilled and experienced Data Engineer with 3 to 8 years of experience. - Strong experience with AWS services:...

  • Data Engineer

    2 months ago


    Bangalore/Chennai, Tamil Nadu, India TekPillar Full time

    Job Title : Data EngineerExperience : 3-8 YearsLocation : Chennai / BangaloreJob Type : Full-timeRequire Skills : Data Engineer, AWS, Airflow, PySpark, Hadoop, Big data, Glue, Athena, Lambda, PythonJob Description :We are seeking a highly skilled and experienced Data Engineer with 3 to 8 years of experience.- Strong experience with AWS services: Glue,...


  • bangalore, India Mopid Full time

    Data Engineer (Python + PySpark) Position Experience Range: 2-6 years Job Timing: This is a full-time position Job Type: The role is designed as a hybrid work arrangement We are seeking a skilled Data Engineer with expertise in Python and PySpark to join our dynamic team in Bengaluru. This position is ideal for individuals with 2-6 years of experience in...


  • bangalore, India Mopid Full time

    Data Engineer (Python + PySpark) PositionExperience Range: 2-6 yearsJob Timing: This is a full-time positionJob Type: The role is designed as a hybrid work arrangementWe are seeking a skilled Data Engineer with expertise in Python and PySpark to join our dynamic team in Bengaluru. This position is ideal for individuals with 2-6 years of experience in the...

  • Data Engineer

    1 month ago


    Bangalore/Hyderabad, Karnataka, India Talent21 Management and Shared Service Pvt Ltd Full time

    Required Skills : - 5+ years' experience, candidate as back end - data engineer. - Strong experience in SQL. - Strong knowledge and experience Python and PySpark. - Experience in AWS. - Experience in Docker and Openshift. - Hands-on experience with REST Concepts. - Design and Develop business solutions on the data front. - Experience in implementation of...

  • Pyspark Engineer

    1 month ago


    bangalore, India Capgemini Engineering Full time

    Responsibilities: Bachelor's degree in Computer Science, Engineering, or related field.Experience in data engineering or data analyst.Should have experience in ETL pipeline development.Proficiency in Python programming language, with experience in data manipulation, data structures, and object-oriented programming.Good experience in SQL/ Advanced SQL.Strong...

  • Data Analyst

    2 months ago


    Bangalore/Hyderabad, Karnataka, India ANRI Solutions HR Services Full time

    Job Description : We are looking for a Data Analyst with 4-8 years of experience who is proficient in Python and PySpark. The successful candidate will analyze large datasets to extract meaningful insights and support data-driven :- Analyze and interpret complex data sets using Python and PySpark.- Develop and maintain dashboards and reports to visualize...

  • Pyspark Engineer

    2 months ago


    bangalore, India Capgemini Engineering Full time

    Responsibilities: Bachelor's degree in Computer Science, Engineering, or related field. Experience in data engineering or data analyst. Should have experience in ETL pipeline development. Proficiency in Python programming language, with experience in data manipulation, data structures, and object-oriented programming. Good experience in SQL/ Advanced...

  • Valiance Solutions

    2 months ago


    Bangalore/Noida, IN Valiance Analytics Pvt. Ltd. Full time

    Job Description Us :Valiance is a global AI & Data analytics firm helping clients build cutting-edge technology solutions for digital transformation. We work with some of the marquee brands across India, US and APAC to build transformative solutions for Credit Risk, Fraud, Predictive Maintenance, Quality Inspection, Data lake, IOT analytics etc. Our team...

  • ETL Data Engineer

    2 months ago


    Bangalore, India Cerebra IT Services Private Limited Full time

    Job Description : We are seeking a highly skilled ETL Data Engineer to join our team in Bangalore. The ideal candidate will have a strong background in ETL processes, along with proficiency in Python, PySpark, and SnowSQL. This role requires a hands-on professional with a proven ability to troubleshoot and optimize ETL jobs while collaborating in a...


  • Bangalore, India Tata Consultancy Services Full time

    JD for Python / Pyspark developer Exp -5 to 15 yrs Location -Hyderabad/Bangalore Proficient in Python Pyspark, including RDDs, Data Frames, and Spark SQL. - Experience in data processing and manipulation using Spark transformations and actions. - Knowledge of Spark architecture and optimization techniques for performance tuning. - Competence...

  • Big Data Engineer

    4 weeks ago


    Bangalore, India Talpro Full time

    Job Description : Key Responsibilities :- Develop and maintain scalable data pipelines using Python, PySpark, and Scala.- Work with Big Data streaming services such as Kinesis, Kafka, and others to process and analyze large data sets.- Manage and optimize NoSQL data stores such as HBase and DynamoDB.- Utilize Hadoop and Big Data processing frameworks like...

  • Big Data Engineer

    2 months ago


    Bangalore, Karnataka, India Talpro Full time

    Job Description :Key Responsibilities :- Develop and maintain scalable data pipelines using Python, PySpark, and Scala.- Work with Big Data streaming services such as Kinesis, Kafka, and others to process and analyze large data sets.- Manage and optimize NoSQL data stores such as HBase and DynamoDB.- Utilize Hadoop and Big Data processing frameworks like...


  • bangalore, India Tata Consultancy Services Full time

    JD for Python / Pyspark developerExp -5 to 15 yrsLocation -Hyderabad/BangaloreProficient in Python Pyspark, including RDDs, DataFrames, and Spark SQL.- Experience in data processing and manipulation using Spark transformations and actions.- Knowledge of Spark architecture and optimization techniques for performance tuning.- Competence in programming...


  • Bangalore, Karnataka, India GetHyr Full time

    Responsibilities : Data Pipeline Development : Design, implement, and maintain scalable data pipelines using PySpark to process and transform large datasets efficiently.Workflow Orchestration : Develop, schedule, and monitor complex data workflows and ETL processes using Apache Airflow.Data Management : Manage and optimize data storage solutions, ensuring...