KC Executive Search | Python, Pyspark Data Engineer | india
5 hours ago
Technical Stack: Python, Spark, AWS, PySpark
Responsibilities
Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.
Collaborate with product and technology teams to design and validate the capabilities of the data platform Identify, design, and implement process improvements: automating manual processes, optimizing for usability, re-designing for greater scalability Provide technical support and usage guidance to the users of our platform’s services.
Drive the creation and refinement of metrics, monitoring, and alerting mechanisms to give us the visibility we need into our production services.
Qualifications
· Experience building and optimizing data pipelines in a distributed environment
Data Modelling and Design Experience of atleast 5 years
· Experience supporting and working with cross-functional teams
· Proficiency working in Linux environment
8+ years of advanced working knowledge of SQL, Python, and PySpark
· 8+ years of experience with using a broad range of AWS technologies Mandatory
· Experience using tools such as: Git/Bitbucket, Jenkins/CodeBuild, CodePipeline
· Experience with platform monitoring and alerts tools
-
india KC Executive Search Full timeTechnical Stack: Python, Spark, AWS, PySpark Responsibilities Develop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation. Collaborate with product and technology teams to design and validate the capabilities of the data platform Identify, design, and implement process...
-
india KC Executive Search Full timeTechnical Stack: Python, Spark, AWS, PySparkResponsibilitiesDevelop and enhance data-processing, orchestration, monitoring, and more by leveraging popular open-source software, AWS, and GitLab automation.Collaborate with product and technology teams to design and validate the capabilities of the data platform Identify, design, and implement process...
-
Executive Search Professional
2 days ago
India Suri Executive Search Full timeCompany OverviewSuri Executive Search (SES) is a boutique firm based in India, specializing in C-Suite and Specialist searches for global companies. Founded by Novlen Suri, SES brings cumulative experience and domain knowledge through a team of experienced partners and researchers.About the RoleThis is a full-time on-site position for an Executive Search...
-
Suri Executive Search | Recruiter | india
3 days ago
india Suri Executive Search Full timeCompany DescriptionSuri Executive Search (SES) is a boutique firm based in Mumbai, specializing in C-Suite and Specialist searches for global and Indian companies. Founded by Novlen Suri, SES brings cumulative over four decades of premier industry experience and domain knowledge through a team of experienced partners and researchers.Role DescriptionThis is a...
-
Suri Executive Search | Recruiter | india
2 days ago
india Suri Executive Search Full timeCompany Description Suri Executive Search (SES) is a boutique firm based in Mumbai, specializing in C-Suite and Specialist searches for global and Indian companies. Founded by Novlen Suri, SES brings cumulative over four decades of premier industry experience and domain knowledge through a team of experienced partners and researchers. Role Description This...
-
Suri Executive Search | Recruiter | india
2 days ago
india Suri Executive Search Full timeCompany Description Suri Executive Search (SES) is a boutique firm based in Mumbai, specializing in C-Suite and Specialist searches for global and Indian companies. Founded by Novlen Suri, SES brings cumulative over four decades of premier industry experience and domain knowledge through a team of experienced partners and researchers. Role Description This...
-
Senior PySpark Data Engineer
1 week ago
India Tata Consultancy Services Full timeAbout the Role:We are seeking a highly skilled Senior PySpark Data Engineer to join our team at Tata Consultancy Services in Bangalore, India.Job Description:The ideal candidate will have a minimum of 6-10 years of experience in designing and developing scalable data solutions using PySpark. They should have hands-on experience with complex transformations,...
-
india Wavicle Data Solutions Full timeJob Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key Responsibilities:...
-
india Wavicle Data Solutions Full timeJob Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...
-
india Wavicle Data Solutions Full timeJob Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key Responsibilities:...
-
india Data Warehouse Engineer Full timeExperience : 2- 5 YearsPrimary Skills : Strong SQL knowledge, Data warehouse concepts and ETL hands on experience, Azure services like Data Factory, Azure Data Lake, and Good analysis skills.Good to have skills: Power BI, Databricks, Python.
-
Apache Pyspark, Azure Data Factory, Python
5 months ago
India growel softech Full timeApache PySpark, Azure Data Factory, PYTHON Apache PySpark, Azure Data Factory, PYTHON C1,C2 Any location
-
Cloud Data Engineering Lead
5 days ago
India ITI Data Full timeITI Data is seeking a highly skilled Cloud Data Engineering Lead to spearhead the design and development of scalable data pipelines on AWS. With a strong background in PySpark, Python, and AWS services, you will be responsible for building robust data integration solutions that enable data-driven insights across various internal and external sources.This is...
-
Data Engineer
1 week ago
Anywhere in India/Multiple Locations Crescendo Global Full timeJob Description : Are you an experienced Data Engineer with expertise in Python, Pyspark, and AWS? Our client, a leading technology firm in India, is looking for a Senior Data Engineer to join their team. If you have a strong analytical mindset and a passion for leveraging data to drive business insights, this opportunity is perfect for you.Location : PAN...
-
KCS iT | SAP C4C Consultant | india
3 weeks ago
india KCS iT Full time@ KCS IT, we look for the ones that stands out, for those that always wants to be better and fight for it, and for those who has the same values that we do: dedication, energy, integrity, transparency, flexibility, trust, honesty, hard work, proactivity, team work. At KCS we stand for equality and value diversity. We create a safe, diverse environment where...
-
KCS iT | SAP C4C Consultant | india
3 weeks ago
india KCS iT Full time@ KCS IT, we look for the ones that stands out, for those that always wants to be better and fight for it, and for those who has the same values that we do: dedication, energy, integrity, transparency, flexibility, trust, honesty, hard work, proactivity, team work.At KCS we stand for equality and value diversity. We create a safe, diverse environment where...
-
KCS iT | SAP C4C Consultant | india
3 weeks ago
india KCS iT Full time@ KCS IT, we look for the ones that stands out, for those that always wants to be better and fight for it, and for those who has the same values that we do: dedication, energy, integrity, transparency, flexibility, trust, honesty, hard work, proactivity, team work. At KCS we stand for equality and value diversity. We create a safe, diverse environment where...
-
Lead Data Engineer
3 weeks ago
India Wavicle Data Solutions Full timeJob Description:We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering.As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success.Key Responsibilities:Lead...
-
Lead Data Engineer
3 weeks ago
India Wavicle Data Solutions Full timeJob Description: We are seeking a highly experienced Lead Data Engineer with over 8 years of expertise in data engineering. As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions. Your proficiency in Python, PySpark, AWS, Databricks, SQL, and leadership skills will be crucial for success. Key...
-
AWS Data Engineer
4 months ago
India ITI Data Full timeJob Description We are looking for an AWS Data with primary skills on PySpark development who will be able to design and build solutions for one of our Fortune 500 Client programs, which aims towards building an Enterprise Data Lake on AWS Cloud platform, build Data pipelines by developing several AWS Data Integration, Engineering & Analytics resources....