
Data Engineer- PySpark
3 days ago
- Build up data pipelines for consumption by the data science team.
- Clear understanding and experience with Python and PySpark.
- Experience in writing Python programs and SQL queries.
- Experience in SQL Query tuning.
- Build and maintain data pipelines in Pyspark with SQL and Python.
- Knowledge of Cloud (Azure/AWS) technologies is additional. Suggest and implement best practices in data integration.
- Split the planned deliverables into tasks and assign them to the team.
- Good oral, written and presentation skills.
Requirements
- Degree in Computer Science, IT, or a similar field; a master's is a plus. Hands-on experience with Python and Pyspark
- 3-5 years of hands-on experience in Python, PySpark, and SQL.
- Great numerical and analytical skills.
- Proven expertise in building and optimizing data pipelines using Spark and Hadoop ecosystem tools.
- Experience working on cloud platforms like Azure or AWS.
- Should be able to collaborate and coordinate in a remote environment. Be a problem solver and be proactive to solve the challenges that come his way.
-
Pyspark Data Engineer
3 days ago
Chennai, Tamil Nadu, India Prowesstics Full time ₹ 15,00,000 - ₹ 25,00,000 per yearWe are looking for a skilledData Engineerwith hands-on experience inPySparkandDatabricksto design, develop, and optimize large-scale data pipelines. The ideal candidate should have strong problem-solving skills, experience working in cloud-based environments, and the ability to collaborate effectively with cross-functional teams.Key Responsibilities:Develop...
-
Pyspark Developer
2 weeks ago
Chennai, Tamil Nadu, India MP DOMINIC AND CO Full timeJob Summary - Design develop and implement scalable data pipelines and streaming use cases using PySpark and Spark on a distributed computing platform - Possess strong programming skills in Spark streaming - Have familiarity with cloud platforms like GCP - Gain experience in big data technologies such as Hadoop Hive and HDFS - Perform ETL operations...
-
Pyspark Developer
1 day ago
Chennai, Tamil Nadu, India Citi Full time ₹ 12,00,000 - ₹ 36,00,000 per yearDiscover your future at CitiWorking at Citi is far more than just a job. A career with us means joining a team of more than 230,000 dedicated people from around the globe. At Citi, you'll have the opportunity to grow your career, give back to your community and make a real impact.Job OverviewAt Citi we're not just building technology, we're building the...
-
Data Engineer
1 day ago
Chennai, Tamil Nadu, India LEONZ TECHNOLOGIEES PVT LTD Full time ₹ 1,04,000 - ₹ 1,30,878 per yearPosition Overview:We are seeking a highly skilled and proactive Data Engineer with a strong focus on Databricks and PySpark to join our data team. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines that drive high-performance data processing in a cloud environment.Key Responsibilities:Design, develop,...
-
Data Engineer
1 week ago
Chennai, Tamil Nadu, India SecureKloud Full time ₹ 9,00,000 - ₹ 12,00,000 per yearChennai | Data Engineer | Full-Time | Exp: 5+ Years | ID: | openings: 1Mandatory Skills: Python, Pyspark, AWS, ETL Tool (Airflow or Talend)Key Responsibilities: Perform data engineering activities that include data modelling, analysis, cleansing, processing, extraction and visualization. Build batch or near real time ETL data pipelines using Talend, AWS...
-
Databrick Pyspark
3 days ago
Chennai, Tamil Nadu, India Virtusa Full time ₹ 5,00,000 - ₹ 15,00,000 per yearKey Responsibilities:Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks. Write efficient and production-ready PySpark or Scala code for data transformation and ETL processes. Integrate data from various structured and unstructured sources into a unified platform. Implement Delta Lake and manage data versioning, updates,...
-
Data Engineer
3 weeks ago
Chennai, Tamil Nadu, India Impetus Career Consultants Full timeData Engineer (T3) – ChennaiWe are hiring a Data Engineer (T3) with 3–6 years of experience in building scalable data pipelines and working on modern cloud & big data platforms.Location: Chennai Experience: 3–6 years Tech Stack: AWS, Python, PySpark, SQLKey Requirements:Strong in Python, SQL, PySpark, Bash scripting.Experience in ETL, data pipelines,...
-
Data Engineer
1 week ago
Chennai, Tamil Nadu, India VCMC LIMITED Full time ₹ 15,00,000 - ₹ 25,00,000 per yearGreeting from Ashra TechnologiesWe are HiringRole: Data EngineerData Engineer (AWS + pySpark)NoidaJD as provided below• 7+ years of overall IT experience, which includes hands on experience in Big Data technologies.• Mandatory - Hands on experience in Python and PySpark.• Build pySpark applications using Spark Dataframes in Python.• Worked on...
-
Azure Data Engineer
23 hours ago
Chennai, Tamil Nadu, India Kovan Technology Solutions Full time ₹ 8,00,000 - ₹ 24,00,000 per yearHi Professionals,Apply : Hiring: Data Engineer (Azure Data Platform, ADF, Python, PySpark) Location: Hyderabad, Bangalore, ChennaiMode of Work: Work from OfficeExperience: YearsJob Description:Bachelor's or master's degree in Computer Science, IT, or related field.5+ years of data engineering experience, including 1+ years on Azure Data Platform.Strong...
-
Data Engineer
1 week ago
Chennai, Tamil Nadu, India SECUREKLOUD TECHNOLOGIES Full time ₹ 6,00,000 - ₹ 18,00,000 per yearRole: Data EngineerExperience: 5+ YearsWork Location: Chennai T. Nagar (Work from Office)About the Role:We are seeking a highly skilled Data Engineer to join our team and help us build robust, scalable, and efficient data pipelines. You will play a crucial role in designing, developing, and maintaining data solutions that power our business decisions.Skills...