Senior PySpark Data Engineer

1 week ago


Bengaluru, Karnataka, India Andor Tech Full time

Job Title: Senior PySpark Data Engineer

About the Role:

We are seeking a highly skilled Senior PySpark Data Engineer to join our data engineering team at Andor Tech in Bengaluru. As a key member of our team, you will play a vital role in designing, building, and maintaining large-scale data processing pipelines using Python and PySpark.

About You:

To succeed in this position, you should have a solid foundation in Python programming, with significant experience working with PySpark for big data processing. Your expertise will enable you to build efficient, reusable, and scalable code for large data processing tasks. Additionally, you should be able to collaborate with data engineers and analysts to understand and implement data requirements.

Key Responsibilities:

  • Design, develop, test, and maintain complex data processing pipelines using Python and PySpark.
  • Write high-quality, efficient, and optimized code for large data processing tasks.
  • Collaborate with cross-functional teams to ensure data quality, integrity, and consistency throughout data processing workflows.
  • Optimize and troubleshoot Spark jobs for performance, reliability, and scalability.

Requirements:

  • Bachelor's degree in Computer Science, Engineering, or a related field.
  • Strong proficiency in Python programming and extensive experience with PySpark.
  • Excellent problem-solving skills and ability to work in a fast-paced environment.
  • Strong knowledge of ETL processes, data manipulation, and SQL.

What We Offer:

We offer a competitive salary range of ₹1,200,000 - ₹1,800,000 per annum, commensurate with experience. Our comprehensive benefits package includes health insurance, retirement plans, and opportunities for professional growth and development. Join us in shaping the future of data engineering at Andor Tech



  • Bengaluru, Karnataka, India Minutes to Seconds Pty Ltd Full time

    About the JobAt Minutes to Seconds, we're on a mission to match talented individuals with the perfect job opportunities. Our goal is to provide a seamless fit between skills and roles, driving success for both our candidates and clients.We're currently seeking a skilled Senior PySpark Developer to join our dynamic team. As a key member of our team, you'll be...

  • Senior Data Engineer

    3 weeks ago


    Bengaluru, Karnataka, India Société Générale Assurances Full time

    Job Description:Societe Generale Assurances is seeking a highly skilled Senior Data Engineer to join our team. In this role, you will be responsible for designing, developing, and maintaining large-scale data processing systems using PySpark and Spark SQL.Key Responsibilities:Develop and implement complex data pipelines using PySpark and Spark SQLMaintain...


  • Bengaluru, Karnataka, India LTIMindtree Full time

    Job DescriptionWe are seeking a highly skilled Senior Pyspark Engineer to lead our data processing tasks using PySpark/Spark.The ideal candidate will have deep experience in developing data processing tasks, including reading data from external sources, merging data, and loading into target data destinations.Key Responsibilities:Develop, program, and...


  • Bengaluru, Karnataka, India Capgemini Full time

    About the RoleLead the development and implementation of large-scale data processing systems using PySpark.Collaborate with cross-functional teams to design and deploy big data solutions.Maintain and improve existing data processing architectures.Develop and implement data pipelines to process and analyze large datasets.Key ResponsibilitiesDesign and develop...


  • Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Company OverviewTata Consultancy Services is a leading IT services company that helps clients transform and grow their businesses.Job DescriptionWe are seeking an experienced Senior Big Data Engineer to join our team. As a Senior Big Data Engineer, you will be responsible for designing, developing, and deploying big data solutions using technologies such as...

  • Big Data Engineer

    2 days ago


    Bengaluru, Karnataka, India Tata Consultancy Services Full time

    About the RoleWe are seeking a highly skilled Big Data Engineer with expertise in PySpark to join our team at Tata Consultancy Services. As a key member of our data engineering team, you will be responsible for designing and implementing scalable big data pipelines using PySpark.Key ResponsibilitiesDesign, develop, and deploy complex big data pipelines using...


  • Bengaluru, Karnataka, India NTT DATA Services Full time

    Data Engineering Senior Specialist RoleDiverse and dynamic Data Engineering activities on Azure Data platform. The role involves building and delivering Data pipelines connecting various enterprise data sources, both RDBMS and NoSQL. Develop data mappings to existing data sources and design big data processing notebooks using Azure Databricks. Scripting and...


  • Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Job OverviewWe are seeking an experienced Senior PySpark Developer to join our team at Tata Consultancy Services. As a key member of our data analytics group, you will be responsible for designing and developing large-scale data processing systems using PySpark.


  • Bengaluru, Karnataka, India Hiring House Technology Full time

    Job Title: Leading Data Engineer - PySpark DevelopmentHiring House Technology seeks an experienced Data Engineer with expertise in PySpark development to join our team. The ideal candidate will have a proven track record of designing and developing robust data pipelines using Apache Spark.The successful applicant will be responsible for:Designing,...


  • Bengaluru, Karnataka, India Careerhaat Full time

    We are seeking a highly skilled Data Engineering Specialist to join our team at Careerhaat, based in Bengaluru. This is a permanent position with company payroll, offering a competitive salary.Job Description:In this role, you will be instrumental in designing, developing, and maintaining ETL processes using Databricks PySpark to extract, transform, and load...

  • Data Engineer

    2 weeks ago


    Bengaluru, Karnataka, India Société Générale Assurances Full time

    At Société Générale Assurances, we are seeking a skilled Data Engineer to join our team. As a key member of our technology department, you will be responsible for designing, developing, and maintaining large-scale data processing systems using PySpark and ETL concepts.Salary: ₹2,500,000 per annum, commensurate with experience.Job DescriptionWe are...


  • Bengaluru, Karnataka, India Tata Consultancy Services Full time

    Job Title: Data Engineering Platform Developer - Hadoop and PySpark Expert">About the Role:">Tata Consultancy Services (TCS) is a leading IT services company that provides innovative solutions to clients across various industries. We are seeking an experienced Data Engineering Platform Developer with expertise in Hadoop and PySpark to join our team.">Key...

  • Cloud Data Engineer

    3 days ago


    Bengaluru, Karnataka, India SKYLARK HR SOLUTIONS Pvt Ltd Full time

    Job DescriptionWe are seeking a highly skilled Cloud Data Engineer with expertise in AWS and PySpark to join our team at SKYLARK HR SOLUTIONS Pvt Ltd.Company OverviewAs a leading provider of human resource solutions, we strive to deliver exceptional services to our clients. Our team is dedicated to innovation and excellence, and we're looking for talented...


  • Bengaluru, Karnataka, India Hexaware Technologies Full time

    Job Summary:We are seeking a highly skilled Senior Databricks Data Engineer to join our team at Hexaware Technologies.About the Role:This is a challenging and rewarding role that requires expertise in designing, developing, and maintaining large-scale data pipelines using Databricks, Pyspark, and Python.Key Responsibilities:Design and develop efficient...


  • Bengaluru, Karnataka, India Andor Tech Full time

    Job Title:Senior Data EngineerAbout Andor Tech:We are a leading technology firm dedicated to delivering innovative data-driven solutions. Our team of experts is passionate about harnessing the power of data to drive business growth and success.Salary:$120,000 - $180,000 per annum, depending on experience.Job Summary:We are seeking an experienced Senior Data...


  • Bengaluru, Karnataka, India Genpact Full time

    Genpact, a global professional services and solutions firm, invites applications for the role of Senior Principal Consultant-Snowflake Sr.Data Engineer. The position involves providing technical direction and leading a team of developers to achieve business goals.**Job Description**Minimum 5 years of experience in IT industryFamiliarity with data warehousing...

  • Senior Data Engineer

    1 month ago


    Bengaluru, Karnataka, India Expian Technologies Pvt Ltd Full time

    Role SummaryAs a Senior Data Engineer at Expian Technologies Pvt Ltd, you will be responsible for designing, implementing, and maintaining data processing pipelines and workflows using Databricks on the Azure platform. Your expertise in PySpark, SQL, Databricks, test-driven development, and Docker will be essential to the success of our data engineering...


  • Bengaluru, Karnataka, India LTIMindtree Full time

    Welcome to this exciting opportunity to grow your career as a Data Scientist with Expertise in Pyspark and Big Data Analytics at LTIMindtree.We are seeking a highly skilled professional with a strong background in big data engineering and analytics to join our team. Your primary responsibility will be to design, develop, and deploy scalable data...


  • Bengaluru, Karnataka, India AKIRA Insights Full time

    About AKIRA InsightsAkira Insights is a boutique pure-play data and analytics consulting firm providing services to multinational corporations, large enterprises, and Fortune 500s from various sectors. The company's mission is to help businesses unlock valuable insights from their data.Job Title: Senior Data Architect (Big Data Engineer)We are seeking an...

  • PySpark Developer

    3 weeks ago


    Bengaluru, Karnataka, India Hero Motocorp Full time

    About the RoleHero Motocorp is seeking a highly skilled PySpark developer to join its Digital Connected core tech team. The ideal candidate will have extensive experience in ETL coding, cloud technologies, and big data processing.Key ResponsibilitiesDesign and develop scalable connected platforms using PySpark and cloud technologiesWork closely with product...