
Data Engineer- PySpark
1 day ago
- Build up data pipelines for consumption by the data science team.
- Clear understanding and experience with Python and PySpark.
- Experience in writing Python programs and SQL queries.
- Experience in SQL Query tuning.
- Build and maintain data pipelines in Pyspark with SQL and Python.
- Knowledge of Cloud (Azure/AWS) technologies is additional. Suggest and implement best practices in data integration.
- Split the planned deliverables into tasks and assign them to the team.
- Good oral, written and presentation skills.
Requirements
- Degree in Computer Science, IT, or a similar field; a master's is a plus. Hands-on experience with Python and Pyspark
- 3-5 years of hands-on experience in Python, PySpark, and SQL.
- Great numerical and analytical skills.
- Proven expertise in building and optimizing data pipelines using Spark and Hadoop ecosystem tools.
- Experience working on cloud platforms like Azure or AWS.
- Should be able to collaborate and coordinate in a remote environment. Be a problem solver and be proactive to solve the challenges that come his way.
-
Pyspark Data Engineer
1 day ago
Chennai, Tamil Nadu, India Prowesstics Full time ₹ 15,00,000 - ₹ 25,00,000 per yearWe are looking for a skilledData Engineerwith hands-on experience inPySparkandDatabricksto design, develop, and optimize large-scale data pipelines. The ideal candidate should have strong problem-solving skills, experience working in cloud-based environments, and the ability to collaborate effectively with cross-functional teams.Key Responsibilities:Develop...
-
Data Engineer Pyspark
5 days ago
Chennai, Tamil Nadu, India NatWest Group Full time ₹ 15,00,000 - ₹ 25,00,000 per yearJoin us as a Data EngineerThis is an exciting opportunity to use your technical expertise to collaborate with colleagues and build effortless, digital first customer experiencesYou'll be simplifying the bank by developing innovative data driven solutions, using insight to be commercially successful, and keeping our customers' and the bank's data safe and...
-
Data Engineer
7 days ago
Chennai, Tamil Nadu, India CX Data Labs Full time ₹ 15,00,000 - ₹ 25,00,000 per yearHiRole - Azure Data EngineerLocation - Chennai, Gurugram (5days Office)Full timeShift timing 2pm to 11pmKey Responsibilities:· Develop, maintain, and optimize scalable ETL/ELT pipelines using PySpark and Databricks.· Collaborate with cross-functional teams to design and implement data models and data integration solutions.· Create and maintain robust SQL...
-
Pyspark
2 weeks ago
Chennai, Tamil Nadu, India Cognizant Technology Solutions Full time ₹ 12,00,000 - ₹ 36,00,000 per yearJob SummaryAs a Sr. Developer you will play a pivotal role in optimizing and enhancing our data processing capabilities using PySpark and AWS technologies. Your expertise in Python and domain knowledge in Cards & Payments will drive impactful solutions. This hybrid role offers the flexibility of day shifts ensuring a balanced work-life...
-
Pyspark Developer
2 days ago
Chennai, Tamil Nadu, India Citi Full time ₹ 12,00,000 - ₹ 36,00,000 per yearDiscover your future at CitiWorking at Citi is far more than just a job. A career with us means joining a team of more than 230,000 dedicated people from around the globe. At Citi, you'll have the opportunity to grow your career, give back to your community and make a real impact.Job OverviewAt Citi we're not just building technology, we're building the...
-
Data Engineer
2 days ago
Chennai, Tamil Nadu, India LEONZ TECHNOLOGIEES PVT LTD Full time ₹ 1,04,000 - ₹ 1,30,878 per yearPosition Overview:We are seeking a highly skilled and proactive Data Engineer with a strong focus on Databricks and PySpark to join our data team. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines that drive high-performance data processing in a cloud environment.Key Responsibilities:Design, develop,...
-
Data Engineer
7 days ago
Chennai, Tamil Nadu, India VCMC LIMITED Full time ₹ 15,00,000 - ₹ 25,00,000 per yearGreeting from Ashra TechnologiesWe are HiringRole: Data EngineerData Engineer (AWS + pySpark)NoidaJD as provided below• 7+ years of overall IT experience, which includes hands on experience in Big Data technologies.• Mandatory - Hands on experience in Python and PySpark.• Build pySpark applications using Spark Dataframes in Python.• Worked on...
-
Data Engineer
1 week ago
Chennai, Tamil Nadu, India Work Fox Solutions Full time ₹ 9,00,000 - ₹ 12,00,000 per yearData EngineerMaintain ETL pipelines using Databricks and PySpark to extract, transform, and load data from various sources.Troubleshoot and resolve issues related to data transformations or loading processes in Databricks.Develop and maintain documentation for ETL processes, configurations, and data mappings.Strong proficiency in Databricks with hands-on...
-
Azure Data Engineer
1 day ago
Chennai, Tamil Nadu, India Kovan Technology Solutions Full time ₹ 8,00,000 - ₹ 24,00,000 per yearHi Professionals,Apply : Hiring: Data Engineer (Azure Data Platform, ADF, Python, PySpark) Location: Hyderabad, Bangalore, ChennaiMode of Work: Work from OfficeExperience: YearsJob Description:Bachelor's or master's degree in Computer Science, IT, or related field.5+ years of data engineering experience, including 1+ years on Azure Data Platform.Strong...
-
Data Engineer
1 week ago
Chennai, Tamil Nadu, India ixceed Full time ₹ 30,00,000 - ₹ 35,00,000 per yearRole: Data Engineer (Scala)Location: ChennaiWork Mode: HybridEmployment Type: Full-time PermanentOverview:We are seeking an experienced Senior Data Engineer with deep expertise in Scala and big data technologies to contribute to a cutting-edge project. This role focuses on designing and implementing high-performance data pipelines and processing frameworks,...