Data Engineer- PySpark

3 days ago


Chennai, Tamil Nadu, India Cynosure Corporate Solutions Full time ₹ 9,00,000 - ₹ 12,00,000 per year
  • Build up data pipelines for consumption by the data science team.
  • Clear understanding and experience with Python and PySpark.
  • Experience in writing Python programs and SQL queries.
  • Experience in SQL Query tuning.
  • Build and maintain data pipelines in Pyspark with SQL and Python.
  • Knowledge of Cloud (Azure/AWS) technologies is additional. Suggest and implement best practices in data integration.
  • Split the planned deliverables into tasks and assign them to the team.
  • Good oral, written and presentation skills.

Requirements

  • Degree in Computer Science, IT, or a similar field; a master's is a plus. Hands-on experience with Python and Pyspark
  • 3-5 years of hands-on experience in Python, PySpark, and SQL.
  • Great numerical and analytical skills.
  • Proven expertise in building and optimizing data pipelines using Spark and Hadoop ecosystem tools.
  • Experience working on cloud platforms like Azure or AWS.
  • Should be able to collaborate and coordinate in a remote environment. Be a problem solver and be proactive to solve the challenges that come his way.


  • Chennai, Tamil Nadu, India Prowesstics Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    We are looking for a skilledData Engineerwith hands-on experience inPySparkandDatabricksto design, develop, and optimize large-scale data pipelines. The ideal candidate should have strong problem-solving skills, experience working in cloud-based environments, and the ability to collaborate effectively with cross-functional teams.Key Responsibilities:Develop...

  • Pyspark Developer

    2 weeks ago


    Chennai, Tamil Nadu, India MP DOMINIC AND CO Full time

    Job Summary - Design develop and implement scalable data pipelines and streaming use cases using PySpark and Spark on a distributed computing platform - Possess strong programming skills in Spark streaming - Have familiarity with cloud platforms like GCP - Gain experience in big data technologies such as Hadoop Hive and HDFS - Perform ETL operations...

  • Pyspark Developer

    1 day ago


    Chennai, Tamil Nadu, India Citi Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Discover your future at CitiWorking at Citi is far more than just a job. A career with us means joining a team of more than 230,000 dedicated people from around the globe. At Citi, you'll have the opportunity to grow your career, give back to your community and make a real impact.Job OverviewAt Citi we're not just building technology, we're building the...

  • Data Engineer

    1 day ago


    Chennai, Tamil Nadu, India LEONZ TECHNOLOGIEES PVT LTD Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Position Overview:We are seeking a highly skilled and proactive Data Engineer with a strong focus on Databricks and PySpark to join our data team. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines that drive high-performance data processing in a cloud environment.Key Responsibilities:Design, develop,...

  • Data Engineer

    1 week ago


    Chennai, Tamil Nadu, India SecureKloud Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Chennai | Data Engineer | Full-Time | Exp: 5+ Years | ID: | openings: 1Mandatory Skills: Python, Pyspark, AWS, ETL Tool (Airflow or Talend)Key Responsibilities: Perform data engineering activities that include data modelling, analysis, cleansing, processing, extraction and visualization. Build batch or near real time ETL data pipelines using Talend, AWS...

  • Databrick Pyspark

    3 days ago


    Chennai, Tamil Nadu, India Virtusa Full time ₹ 5,00,000 - ₹ 15,00,000 per year

    Key Responsibilities:Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks. Write efficient and production-ready PySpark or Scala code for data transformation and ETL processes. Integrate data from various structured and unstructured sources into a unified platform. Implement Delta Lake and manage data versioning, updates,...

  • Data Engineer

    3 weeks ago


    Chennai, Tamil Nadu, India Impetus Career Consultants Full time

    Data Engineer (T3) – ChennaiWe are hiring a Data Engineer (T3) with 3–6 years of experience in building scalable data pipelines and working on modern cloud & big data platforms.Location: Chennai Experience: 3–6 years Tech Stack: AWS, Python, PySpark, SQLKey Requirements:Strong in Python, SQL, PySpark, Bash scripting.Experience in ETL, data pipelines,...

  • Data Engineer

    1 week ago


    Chennai, Tamil Nadu, India VCMC LIMITED Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Greeting from Ashra TechnologiesWe are HiringRole: Data EngineerData Engineer (AWS + pySpark)NoidaJD as provided below• 7+ years of overall IT experience, which includes hands on experience in Big Data technologies.• Mandatory - Hands on experience in Python and PySpark.• Build pySpark applications using Spark Dataframes in Python.• Worked on...

  • Azure Data Engineer

    23 hours ago


    Chennai, Tamil Nadu, India Kovan Technology Solutions Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Hi Professionals,Apply :  Hiring: Data Engineer (Azure Data Platform, ADF, Python, PySpark) Location: Hyderabad, Bangalore, ChennaiMode of Work: Work from OfficeExperience: YearsJob Description:Bachelor's or master's degree in Computer Science, IT, or related field.5+ years of data engineering experience, including 1+ years on Azure Data Platform.Strong...

  • Data Engineer

    1 week ago


    Chennai, Tamil Nadu, India SECUREKLOUD TECHNOLOGIES Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Role: Data EngineerExperience: 5+ YearsWork Location: Chennai T. Nagar (Work from Office)About the Role:We are seeking a highly skilled Data Engineer to join our team and help us build robust, scalable, and efficient data pipelines. You will play a crucial role in designing, developing, and maintaining data solutions that power our business decisions.Skills...