Senior Data Engineer

2 weeks ago

Chennai, India YO IT CONSULTING Full time

Job Description : Title : Senior Data EngineerExperience : 6 to 8 yearsLocation : ChennaiMust Have : - SQL- Databricks- PySpark- PythonRole And Responsibilities : The Data Engineer will be responsible for designing and developing data engineering solutions, creating and maintaining data models, building Extract Transform Load (ETL) pipelines, implementing data warehousing, and performing data analytics on large datasets.- Data Engineering and Data Modeling skills- Experience with Extract Transform Load (ETL) pipelines- Expertise in implementing data warehousing solutions- Analytical skills for performing data analytics on large datasets- Strong programming skills in languages like Python, Java, or Scala- Experience with Big Data and cloud-based technologies like Hadoop, Spark, and AWS- Understanding of data governance and security principles- Bachelor's degree in Computer Science, Information Systems, or related field- Strong communication skills and ability to work independently and collaborativelyPrimary Capabilities : SQL Expertise : - Proficiency in writing complex SQL queries.- Experience with database design and optimization.- Ability to perform data manipulation and analysis.Databricks Experience : - Hands-on experience with Databricks platform.- Familiarity with Databricks' integration with various data sources and sinks.- Experience in building and optimizing big data pipelines using Databricks.PySpark Proficiency : - Strong skills in PySpark for large-scale data processing.- Understanding of PySpark's architecture and its application in data processing and transformation tasks.- Ability to write efficient, scalable, and reusable code in PySpark.Python Programming : - Strong programming skills in Python.- Experience with Python libraries relevant to data engineering (e.g., Pandas, NumPy).- Ability to write clean, maintainable, and efficient code in Python.AWS Experience : - Knowledge of AWS services relevant to data engineering (e.g., S3, Lambda, CodeCommit, etc.,).- Knowledge in building and maintaining data infrastructures on AWS.- Understanding of cloud computing concepts and how they apply to data engineering tasks.Analytics Skills : - Ability to derive insights from large datasets.- Knowledge of data visualization tools and techniques.- Proficiency in statistical analysis and using data to inform decisions.Logical Thinking and Problem-Solving : - Strong logical reasoning and analytical skills.- Proven ability to troubleshoot and solve complex problems.- Capacity to break down and simplify complex problems, developing practical, efficient solutions.Other Desirable Qualifications : - Bachelors or Masters degree in Computer Science, Engineering, or a related field.- Good communication skills and the ability to work collaboratively in a team.- Experience with version control tools like Git, CodeCommit.- Familiarity with Agile methodologies and DevOps practices.- Certification in relevant technologies (e.g., Databricks, AWS Certified Data Analytics) is a plus (ref:hirist.tech)

  • Senior Data Engineer

    3 weeks ago

    Chennai, India Eucloid Data Solutions Full time

    Job Description: Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...

  • Senior Data Engineer

    3 weeks ago

    Chennai, India Eucloid Data Solutions Full time

    Job Description:Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...

  • Senior Data Engineer

    3 weeks ago

    Chennai, India Eucloid Data Solutions Full time

    Job Description: Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...

  • Senior Data Engineer

    3 weeks ago

    Chennai, India Eucloid Data Solutions Full time

    Job Description: Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...

  • Senior Data Engineer

    3 weeks ago

    Chennai, India Eucloid Data Solutions Full time

    Job Description:Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...

  • Senior Data Engineer

    3 weeks ago

    Chennai, India Eucloid Data Solutions Full time

    Job Description:Eucloid is looking for a Senior Data Engineer to join our Data Platform team supporting various business applications. The ideal candidate will support development of data infrastructure for our clients by participating in activities which may include starting from up- stream and down-stream technology selection to designing and building of...

  • Senior Data scientist

    1 week ago

    Chennai, Tamil Nadu, India Crayon Data Full time ₹ 12,00,000 - ₹ 36,00,000 per year

    Senior Data Scientist Chennai (AI/ML & BFSI Focus) From models to measurable impact — drive real change with AI.Location: Chennai, India Experience: 6–8 years in Data Science/ML (preferably in BFSI or other data-rich industries) Innovators who don't just build models but drive measurable business impact. Expertise: Fierce desire to use AI in every...

  • Data Engineer

    1 day ago

    Chennai, Tamil Nadu, India AABM Cloud Data Solution Full time ₹ 20,00,000 - ₹ 25,00,000 per year

    We are seeking a Senior Data Engineer with10+ yearsof experience to join our team.Required Qualifications10+ years of experience in data engineering or similar role.Hands on experience in snowflake, SSIS, Python ( including NumPy and Pandas) is mandatory.Expertise in SQL and any cloud environment (AWS & Azure, etc.) is mandatory.Proficiency in mordern BI...

  • Senior Software Engineer

    1 week ago

    Chennai, Tamil Nadu, India Crayon Data Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Senior Software Engineer Chennai (AI/ML Engineering Focus) Build the backbone of AI — engineer the systems that power enterprise intelligenceLocation: Chennai, India Experience: 6–8 years in software engineering (preferably in AI/ML or data-driven product development) Problem solvers who don't just write code but build scalable, impactful AI...

  • Senior Data Consultant

    3 weeks ago

    Chennai, India Eucloid Data Solutions Full time

    We are looking for a high-energy individual for the role of Senior Data Consultant at Eucloid. The candidate will collaborate with client stakeholders on multiple projects in the eCommerce team.The candidate is expected to lead following work-streams:• Drive client meetings with data-driven insights and observations on key website/app metricsfor Upper...