Current jobs related to Lead PySpark Developer - india - AJ Consulting

  • Lead PySpark Developer

    4 weeks ago

    India AJ Consulting Full time

    Position Name : Lead PySpark DeveloperExperience : 10 - 16 yrs Location : Pan IndiaBudget : 46 LPA max including variablesNotice Period : Immediate to Serving NP (30 Days max remaining)Job Description :Primary Skill : Lead PySpark Skill : SAS tools - Lead a team of data engineers in the design and implementation of big data solutions using PySpark. -...

  • Lead PySpark Developer

    1 week ago

    Anywhere in India/Multiple Locations AJ Consulting Full time

    Position Name : Lead PySpark Developer Experience : 10 - 16 yrs Location : Pan India Budget : 46 LPA max including variables Notice Period : Immediate to Serving NP (30 Days max remaining) Job Description : Primary Skill : Lead PySpark Skill : SAS tools - Lead a team of data engineers in the design and implementation of big data solutions using PySpark....

  • PySpark Developer

    4 days ago

    India Risk Resources LLP Full time

    Job Description : Must-Have : - Mandatory skill : Pyspark. - 3-6 years of experience in the design and implementation of Big Data pipelines using PySpark, database migration, transformation, and integration solutions for any Data warehousing project. - Must have excellent knowledge in Apache Spark and Python programming experience. - Experience in developing...

  • PySpark Developer

    1 week ago

    India Victrix Inc. Full time

    Job DescriptionSenior PySpark Developer - Complex XML Data ProcessingKey Responsibilities- Design and develop scalable PySpark pipelines to ingest, parse, and process XML datasets with extreme hierarchical complexity.- Implement efficient XPath expressions, recursive parsing techniques, and custom schema definitions to extract data from nested XML...

  • Lead Databricks/PySpark Developer

    4 weeks ago

    India Deltaclass Technology Solutions Pvt. Ltd. Full time

    Required Skills :Job Summary : Looking for an offshore Lead Databricks/PySpark Developer who is willing to learn new technologies if needed and able to work with team. This position is long term and will likely be renewed annually.Essential Job Functions- Design and development of data ingestion pipelines (Databricks background preferred).- Performance tune...

  • PySpark Developer

    4 days ago

    India DATA ECONOMY PRIVATE LIMITED Full time

    Job OverviewDATA ECONOMY PRIVATE LIMITED seeks a skilled PySpark Developer - Data Engineer to lead the development of advanced models using AWS services such as EMR, Glue, and Glue Notebooks. As a key member of our team, you will design, build, and optimize scalable cloud infrastructure solutions with a minimum of 5 years of experience.About the Job- Develop...

  • PySpark XML Pipeline Developer

    4 days ago

    India Victrix Systems & Labs Full time

    About the Role:Victrix Systems & Labs is looking for a seasoned PySpark Developer to lead the development of our XML pipeline architecture. In this role, you will be responsible for implementing efficient data processing pipelines that can handle terabytes of XML data efficiently. Your expertise in Spark XML libraries and XPath expressions will be crucial in...

  • Senior PySpark Developer

    7 days ago

    Anywhere in India/Multiple Locations MWIDM Staffing Services Full time

    About Our CompanyMWIDM Staffing Services is a leading provider of staffing solutions, specializing in placing top talent in data engineering roles.Job Overview:We are seeking an experienced Senior PySpark Developer to join our team. The ideal candidate will have a strong background in designing, developing, and maintaining efficient and reliable data...

  • PySpark Expert

    4 days ago

    India Risk Resources LLP Full time

    About Us:Risk Resources LLP is a leading provider of risk management services. We are committed to delivering high-quality solutions that meet the evolving needs of our clients.Job Overview:We are seeking a talented PySpark Expert to join our team. The successful candidate will be responsible for designing and implementing Big Data pipelines using PySpark,...

  • PySpark Developer

    1 hour ago

    India Victrix Systems & Labs Full time

    Job Overview:We are looking for an experienced PySpark Developer to join our team. As a key member of our data engineering department, you will be responsible for designing and developing high-performance data pipelines to process complex XML datasets.Main Responsibilities:• Develop and maintain efficient data pipelines using PySpark and Spark XML...

  • Lead Databricks/PySpark Developer

    2 weeks ago

    Anywhere in India/Multiple Locations Deltaclass Technology Solutions Pvt. Ltd. Full time

    Required Skills :Job Summary : Looking for an offshore Lead Databricks/PySpark Developer who is willing to learn new technologies if needed and able to work with team. This position is long term and will likely be renewed annually.Essential Job Functions- Design and development of data ingestion pipelines (Databricks background preferred).- Performance tune...

  • Senior PySpark Developer

    4 days ago

    India Victrix Systems & Labs Full time

    Key Responsibilities : - Design and develop scalable PySpark pipelines to ingest, parse, and process XML datasets with extreme hierarchical complexity. - Implement efficient XPath expressions, recursive parsing techniques, and custom schema definitions to extract data from nested XML structures. - Optimize Spark jobs through partitioning, caching, and...

  • - PySpark Developer

    4 days ago

    India DATA ECONOMY PRIVATE LIMITED Full time

    Key Responsibilities : - Model Development : Lead the development of advanced models using AWS services such as EMR, Glue, and Glue Notebooks. - Cloud Infrastructure : Design, build, and optimize scalable cloud infrastructure solutions with a minimum of 5 years of experience. - ETL Pipeline Development : Create, manage, and optimize ETL pipelines using...

  • Data Engineer

    4 weeks ago

    india Synechron Full time

    Greetings,We have an urgent opening for aData Engineer specializing in PySparkat Synechron in Chennai. We are looking for candidates with more than 5+ years of relevant experience.Position: Data Engineer-PysparkLocation:ChennaiAbout Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm...

  • Software Engineer II-PySpark Developer

    4 weeks ago

    Hyderabad, India Chase Bank Full time

    Job Description You're ready to gain the skills and experience needed to grow within your role and advance your career - and we have the perfect software engineering opportunity for you. As a PySpark Developer Software Engineer II at JPMorgan Chase within the Commercial & Investment Bank Payments Technology team, you are part of an agile team that works to...

  • AWS PySpark Data Engineer

    2 weeks ago

    India 9NEXUS Full time

    We are seeking an AWS PySpark Data Engineer to design, develop, and optimize data pipelines in a cloud-based environment. The ideal candidate should have expertise in PySpark, AWS services, and big data processing.Key Responsibilities:Develop and optimize ETL/ELT data pipelines using PySpark on AWS.Work with AWS services like Glue, Lambda, S3,...

  • Aws Glue – Python, Pyspark, Aws

    4 weeks ago

    India CIEL HR Full time

    Exp - 5 yearsSkills - ETL development AWS Glue Python PySpark SQL PostgresqlLocation - Mumbai Pune Chennai BangaloreNotice - 15 days to Immediate1 Experience in analysis design and ETL development2 Strong hands-on experience on AWS Glue Python PySpark SQL Postgresql3 Good knowledge in creating ETL workflows using Python and PySpark with...

  • Python Development Lead

    3 days ago

    India SAPBOT Technologies Full time

    Data Engineering RoleSAPBOT Technologies is a leading provider of innovative data engineering solutions. We are currently seeking a talented Python Development Lead to join our team and lead the development of our data engineering platform. As a key member of our team, you will be responsible for designing and implementing scalable and efficient data...

  • Data Engineer

    9 hours ago

    India Victrix Systems & Labs Full time

    Job Description:At Victrix Systems & Labs, we are seeking a highly skilled Data Engineer to join our team. As a key member of our data engineering department, you will be responsible for designing and developing scalable PySpark pipelines to ingest, parse, and process complex XML datasets with extreme hierarchical complexity.Main Responsibilities:• Design...

  • Data Engineering Lead

    3 days ago

    India Nexionpro Full time

    Nexionpro is seeking a highly skilled Data Engineering Lead to join our team. As a key member of our data engineering group, you will be responsible for designing and developing efficient and scalable ETL pipelines on AWS EMR using Python and PySpark.We are looking for an experienced professional with a strong background in data engineering and a proven...

Lead PySpark Developer

1 month ago

india AJ Consulting Full time

Position Name : Lead PySpark Developer

Experience : 10 - 16 yrs

Location : Pan India

Budget : 46 LPA max including variables

Notice Period : Immediate to Serving NP (30 Days max remaining)

Job Description :

Primary Skill : Lead PySpark Skill : SAS tools


- Lead a team of data engineers in the design and implementation of big data solutions using PySpark.


- Collaborate with cross-functional teams to understand business needs and develop data-driven solutions.


- Design and implement scalable and robust data pipelines using PySpark.


- Ensure data accuracy and integrity by implementing data validation and quality checks.


- Mentor and coach team members in PySpark and big data best practices.


- Stay up-to-date with the latest developments in big data technologies and incorporate them into the team's workflow.


Requirements :


- 9+ years in PySpark/ Data engineer development and implementation


- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.


- Proven experience as a PySpark Lead or similar role.


- Expertise in PySpark and big data technologies such as Hadoop, Hive, and Spark.'


Skills : Hadoop, Spark, Spark SQL - Scala

(ref:hirist.tech)