KC Executive Search | Python, Pyspark Data Engineer | india

5 hours ago


india KC Executive Search Full time

Technical Stack: Python, Spark, AWS, PySpark


Responsibilities

Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.

Collaborate with product and technology teams to design and validate the capabilities of the data platform Identify, design, and implement process improvements: automating manual processes, optimizing for usability, re-designing for greater scalability Provide technical support and usage guidance to the users of our platform’s services.

Drive the creation and refinement of metrics, monitoring, and alerting mechanisms to give us the visibility we need into our production services.


Qualifications

· Experience building and optimizing data pipelines in a distributed environment

Data Modelling and Design Experience of atleast 5 years

· Experience supporting and working with cross-functional teams

· Proficiency working in Linux environment

8+ years of advanced working knowledge of SQL, Python, and PySpark

· 8+ years of experience with using a broad range of AWS technologies Mandatory

· Experience using tools such as: Git/Bitbucket, Jenkins/CodeBuild, CodePipeline

· Experience with platform monitoring and alerts tools



  • india KC Executive Search Full time

    Technical Stack: Python, Spark, AWS, PySpark Responsibilities Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation. Collaborate with product and technology teams to design and validate the capabilities of the data platform Identify, design, and implement process...


  • india KC Executive Search Full time

    Technical Stack: Python, Spark, AWS, PySparkResponsibilitiesDevelop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.Collaborate with product and technology teams to design and validate the capabilities of the data platform Identify, design, and implement process...


  • India Suri Executive Search Full time

    Company OverviewSuri Executive Search (SES) is a boutique firm based in India, specializing in C-Suite and Specialist searches for global companies. Founded by Novlen Suri, SES brings cumulative experience and domain knowledge through a team of experienced partners and researchers.About the RoleThis is a full-time on-site position for an Executive Search...


  • india Suri Executive Search Full time

    Company DescriptionSuri Executive Search (SES) is a boutique firm based in Mumbai, specializing in C-Suite and Specialist searches for global and Indian companies. Founded by Novlen Suri, SES brings cumulative over four decades of premier industry experience and domain knowledge through a team of experienced partners and researchers.Role DescriptionThis is a...


  • india Suri Executive Search Full time

    Company Description Suri Executive Search (SES) is a boutique firm based in Mumbai, specializing in C-Suite and Specialist searches for global and Indian companies. Founded by Novlen Suri, SES brings cumulative over four decades of premier industry experience and domain knowledge through a team of experienced partners and researchers. Role Description This...


  • india Suri Executive Search Full time

    Company Description Suri Executive Search (SES) is a boutique firm based in Mumbai, specializing in C-Suite and Specialist searches for global and Indian companies. Founded by Novlen Suri, SES brings cumulative over four decades of premier industry experience and domain knowledge through a team of experienced partners and researchers. Role Description This...


  • India Tata Consultancy Services Full time

    About the Role:We are seeking a highly skilled Senior PySpark Data Engineer to join our team at Tata Consultancy Services in Bangalore, India.Job Description:The ideal candidate will have a minimum of 6-10 years of experience in designing and developing scalable data solutions using PySpark. They should have hands-on experience with complex transformations,...


  • india Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key Responsibilities:...


  • india Wavicle Data Solutions Full time

    Job Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...


  • india Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key Responsibilities:...


  • india Data Warehouse Engineer Full time

    Experience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.


  • India growel softech Full time

    Apache PySpark, Azure Data Factory, PYTHON Apache PySpark, Azure Data Factory, PYTHON C1,C2 Any location


  • India ITI Data Full time

    ITI Data is seeking a highly skilled Cloud Data Engineering Lead to spearhead the design and development of scalable data pipelines on AWS. With a strong background in PySpark, Python, and AWS services, you will be responsible for building robust data integration solutions that enable data-driven insights across various internal and external sources.This is...

  • Data Engineer

    1 week ago


    Anywhere in India/Multiple Locations Crescendo Global Full time

    Job Description : Are you an experienced Data Engineer with expertise in Python, Pyspark, and AWS? Our client, a leading technology firm in India, is looking for a Senior Data Engineer to join their team. If you have a strong analytical mindset and a passion for leveraging data to drive business insights, this opportunity is perfect for you.Location : PAN...


  • india KCS iT Full time

    @ KCS IT, we look for the ones that stands out, for those that always wants to be better and fight for it, and for those who has the same values that we do: dedication, energy, integrity, transparency, flexibility, trust, honesty, hard work, proactivity, team work. At KCS we stand for equality and value diversity. We create a safe, diverse environment where...


  • india KCS iT Full time

    @ KCS IT, we look for the ones that stands out, for those that always wants to be better and fight for it, and for those who has the same values that we do: dedication, energy, integrity, transparency, flexibility, trust, honesty, hard work, proactivity, team work.At KCS we stand for equality and value diversity. We create a safe, diverse environment where...


  • india KCS iT Full time

    @ KCS IT, we look for the ones that stands out, for those that always wants to be better and fight for it, and for those who has the same values that we do: dedication, energy, integrity, transparency, flexibility, trust, honesty, hard work, proactivity, team work. At KCS we stand for equality and value diversity. We create a safe, diverse environment where...

  • Lead Data Engineer

    3 weeks ago


    India Wavicle Data Solutions Full time

    Job Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...

  • Lead Data Engineer

    3 weeks ago


    India Wavicle Data Solutions Full time

    Job Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...

  • AWS Data Engineer

    4 months ago


    India ITI Data Full time

    Job Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....