Data Engineer- PySpark

22 hours ago

Chennai, Tamil Nadu, India Cynosure Corporate Solutions Full time ₹ 1,04,000 - ₹ 1,30,878 per year
  • Build up data pipelines for consumption by the data science team.
  • Clear understanding and experience with Python and PySpark.
  • Experience in writing Python programs and SQL queries.
  • Experience in SQL Query tuning.
  • Build and maintain data pipelines in Pyspark with SQL and Python.
  • Knowledge of Cloud (Azure/AWS) technologies is additional. Suggest and implement best practices in data integration.
  • Split the planned deliverables into tasks and assign them to the team.
  • Good oral, written and presentation skills.

Requirements

  • Degree in Computer Science, IT, or a similar field; a master's is a plus. Hands-on experience with Python and Pyspark
  • 3-5 years of hands-on experience in Python, PySpark, and SQL.
  • Great numerical and analytical skills.
  • Proven expertise in building and optimizing data pipelines using Spark and Hadoop ecosystem tools.
  • Experience working on cloud platforms like Azure or AWS.
  • Should be able to collaborate and coordinate in a remote environment. Be a problem solver and be proactive to solve the challenges that come his way.

  • AWS/PySpark Engineer

    23 hours ago

    Chennai, Tamil Nadu, India Barclays Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Join us as an AWS/PySpark Engineer at Barclays, where you'll spearhead the evolution of our digital landscape, driving innovation and excellence. You'll harness cutting-edge technology to revolutionise our digital offerings, ensuring unparalleled customer experiences. As a part of team of developers, you will deliver technology stack, using strong analytical...

  • PySpark Developers

    23 hours ago

    Chennai, Tamil Nadu, India LTIMindtree Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    Skill : PySpark DeveloperJob Locations : Chennai, PuneNotice Period : AnyExperience : 3-8 years Job Description :PySpark DeveloperMandatory Skills : (Apache Spark, Big Data Hadoop Ecosystem, SparkSQL, Python)A good professional experience in Bigdata PySpark HIVE Hadoop PLSQLGood knowledge of AWS and SnowflakeGood understanding of CICD and system design...

  • Databrick Pyspark

    22 hours ago

    Chennai, Tamil Nadu, India Virtusa Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Key Responsibilities:Design, develop, and maintain scalable data pipelines using Apache Spark on Databricks. Write efficient and production-ready PySpark or Scala code for data transformation and ETL processes. Integrate data from various structured and unstructured sources into a unified platform. Implement Delta Lake and manage data versioning, updates,...

  • Data Engineer

    24 hours ago

    Chennai, Tamil Nadu, India LEONZ TECHNOLOGIEES PVT LTD Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Position Overview:We are seeking a highly skilled and proactive Data Engineer with a strong focus on Databricks and PySpark to join our data team. The ideal candidate will be responsible for designing, developing, and optimizing scalable data pipelines that drive high-performance data processing in a cloud environment.Key Responsibilities:Design, develop,...

  • Azure Data Engineer

    4 hours ago

    Chennai, Tamil Nadu, India Kovan Technology Solutions Full time ₹ 15,00,000 - ₹ 25,00,000 per year

    Hi Professionals,Apply :  Hiring: Data Engineer (Azure Data Platform, ADF, Python, PySpark) Location: Hyderabad, Bangalore, ChennaiMode of Work: Work from OfficeExperience: YearsJob Description:Bachelor's or master's degree in Computer Science, IT, or related field.5+ years of data engineering experience, including 1+ years on Azure Data Platform.Strong...

  • Data Engineer

    3 weeks ago

    Chennai, Tamil Nadu, India Incedo Inc. Full time

    Incedo is Hiring Data Engineer-GCP : Immediate to 30 days Joiners Preferred Are you passionate about GCP Data Engineers and looking for an exciting opportunity to work on cutting-edge projects? We're looking for a GCP Data Engineer to join our team in Chennai and HyderabadSkills Required:Experience: 3 to 5 years Experience with GCP , Python , Airflow ,...

  • Data Engineer

    21 hours ago

    Chennai, Tamil Nadu, India Decision Point Analytics Full time ₹ 1,04,000 - ₹ 1,30,878 per year

    Company DescriptionDecision Point develops analytics and big data solutions for CPG, Retail, and Consumer-focused industries, working with global Fortune 500 clients. We provide analytical insights and solutions that help develop sales and marketing strategies in the Retail and CPG industry by leveraging diverse data sources, including Point of Sale data,...

  • Data Engineer

    1 day ago

    Chennai, Tamil Nadu, India GMG Full time ₹ 15,00,000 - ₹ 20,00,000 per year

    What we do: GMG is a global well-being company retailing, distributing and manufacturing a portfolio of leading international and home-grown brands across sport, food and health sectors. Its vision is to inspire people to win in ways that make the world better. Today, GMG's investments span four key verticals: GMG Sports, GMG Food, GMG Health, and GMG...

  • Data Engineer

    24 hours ago

    Chennai, Tamil Nadu, India Colan Infotech Private Limited Full time ₹ 9,00,000 - ₹ 12,00,000 per year

    Greetings from Colan Infotech Job Location: ChennaiDesignation:Azure Data engineer with MS Fabric Job Description:Experience: 5-10 Years OnlyJob Location: ChennaiJob Description:Role & Responsibilities:Must Have: Azure Microsoft Fabric Azure Data Factory Python, or PySpark Power BI Experience in Azure Microsoft Fabric Developer to design, develop, and...

  • Senior Data Engineer

    8 minutes ago

    Chennai, Tamil Nadu, India Pan Asia HR Solutions Full time

    Job Title : Senior Data EngineerExperience : 6+ YearsLocation : Chennai, IndiaWork Mode : Hybrid (2-3 days/week onsite)About the Role :We are looking for a highly skilled Senior Data Engineer with a strong background in Python, Java, PySpark, and Google Cloud Platform (GCP) to join our growing data team in Chennai. The ideal candidate should have a deep...