Senior Data Engineer

1 month ago

Chennai, India MARICI Solutions INC Full time

This is a remoteposition.

We are seeking a highly skilled SeniorSpark Engineer with expertise in Python Spark Databricks and AWS tojoin our dynamic team. The ideal candidate will possess a deepunderstanding of Spark architecture and be proficient in finetuningSpark jobs for optimal performance. Additionally strong knowledgeof software engineering best practices DevOps principles includingCI/CD pipelines Kubernetes and either Jenkins Airflow or SageMakeris essential for this role. Experience in MLOps is desirable butnot mandatory.



Requirements
  • Proficiency in Spark Python Databricks andAWS services.
  • 710 years ofexperience
  • Lead the design development andimplementation of Sparkbased solutions for complex data processingtasks.
  • Collaborate with crossfunctional teams togather requirements and translate them into technicalspecifications.
  • Implement best practices in softwareengineering DevOps and MLOpsmethodologies.
  • Design and maintain data pipelines forefficient data processing andanalysis.
  • Perform data modeling and schema design tosupport business requirements.
  • Mentor junior team members and providetechnical guidance as needed.
  • Stay updated with the latest advancements inSpark Python and related technologies and advocate for theiradoption when appropriate.
  • Bachelors degree in Computer ScienceEngineering or a related field. Masters degreepreferred.
  • Strong understanding of software engineeringprinciples and best practices.
  • Handson experience with DevOps tools andpractices including CI/CD pipelines Kubernetes and either JenkinsAirflow or SageMaker.
  • Experience with MLOps practices is aplus.
  • Solid understanding of data engineeringconcepts and data modelingtechniques.
  • Excellent problemsolving skills and attentionto detail.
  • Ability to work independently and lead taskseffectively.
  • Strong communication and interpersonalskills.


Proficiency in Spark, Python, Databricks, and AWSservices. 7-10 years of experience Lead the design, development,and implementation of Spark-based solutions for complex dataprocessing tasks. Collaborate with cross-functional teams to gatherrequirements and translate them into technical specifications.Implement best practices in software engineering, DevOps, and MLOpsmethodologies. Design and maintain data pipelines for efficientdata processing and analysis. Perform data modeling and schemadesign to support business requirements. Mentor junior team membersand provide technical guidance as needed. Stay updated with thelatest advancements in Spark, Python, and related technologies, andadvocate for their adoption when appropriate. Bachelor's degree inComputer Science, Engineering, or a related field. Master's degreepreferred. Strong understanding of software engineering principlesand best practices. Hands-on experience with DevOps tools andpractices including CI/CD pipelines, Kubernetes, and eitherJenkins, Airflow, or SageMaker. Experience with MLOps practices isa plus. Solid understanding of data engineering concepts and datamodeling techniques. Excellent problem-solving skills and attentionto detail. Ability to work independently and lead taskseffectively. Strong communication and interpersonalskills.

  • Data Engineer

    5 days ago

    Chennai, India NTT DATA Full time

    Job Description Req ID: 280008 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN)."Data Engineer...

  • Data Engineer

    4 days ago

    Chennai, India NTT DATA Full time

    Job Description Req ID: 280008 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN)."Data Engineer...

  • Data Engineer

    5 days ago

    Chennai, India NTT DATA Full time

    Job Description Req ID: 269806 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in chennai, Tamil Nādu (IN-TN), India (IN).Azure Data...

  • Data Engineer

    5 days ago

    chennai, India NTT DATA Full time

    Job Description Req ID:  269806  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in chennai, Tamil Nādu (IN-TN), India (IN). Azure Data...

  • Data Engineer

    1 day ago

    chennai, India NTT DATA Full time

    Job Description Req ID:  269806  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in chennai, Tamil Nādu (IN-TN), India (IN). Azure Data...

  • Data Engineer

    4 days ago

    Chennai, India NTT DATA Full time

    Job Description Req ID: 269806 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in chennai, Tamil Nādu (IN-TN), India (IN).Azure Data...

  • Data Engineer

    5 days ago

    Chennai, India NTT DATA Services Full time

    Req ID: 280008 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN)."Data Engineer...

  • Data Engineer

    3 days ago

    Chennai, India NTT DATA Services Full time

    Req ID: 280008  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in Chennai, Tamil Nādu (IN-TN), India (IN). "Data Engineer...

  • Senior Data Engineer

    1 month ago

    Chennai, India Saaki, Argus and Averil Consulting Full time

    We are trusted and dependable partners for quality recruitment services for a number of global organizations. We have built long-lasting relationships with clients by providing value-added services every step of the way. At Saaki, Argus and Averil Consulting we understand the key to a successful engagement is to be adaptive to our clients’ business needs....

  • Eucloid - Senior Data Engineer - Azure Databricks

    5 days ago

    Chennai, India Eucloid Data Solutions Pvt Ltd Full time

    Job Role : Sr. Data Engineer (Databricks)About Eucloid :Eucloid Data Solutions is a fast-growing AI-consulting firm that enables business growth for its clients through advanced Data Analytics, Machine Learning and Data engineering. Eucloid offers bespoke, full stackand datadriven approach to solve highly complex and large-scale business problems for some of...

  • Senior Data Engineer

    5 days ago

    Chennai, India CoreStack Full time

    Job Title: Senior Data Engineer Location: Chennai About Us CoreStack provides a NextGen Cloud Governance platform that empowers enterprises to increase top-line revenues and gain a competitive edge through AI-powered real-time cloud governance on autopilot. CoreStack is successfully deployed with companies across multiple industries such as Healthcare,...

  • Senior Data Engineer

    1 month ago

    Chennai, India ZoomInfo Full time

    As a Senior Data Engineer, you'll have a key role in building and designing the strategy of our finance analytics engineering team under the Enterprise Data Engineering group.Our Technological Stack includes: Airflow, DBT, Python, Snowflake, AWS, GCP, Amplitude, Fivetran, and more.What will you actually be doing? Building, and continuously improving our data...

  • Senior Data Engineer

    1 month ago

    chennai, India ZoomInfo Full time

    As a Senior Data Engineer, you'll have a key role in building and designing the strategy of our finance analytics engineering team under the Enterprise Data Engineering group. Our Technological Stack includes: Airflow, DBT, Python, Snowflake, AWS, GCP, Amplitude, Fivetran, and more. What will you actually be doing? Building, and continuously improving our...

  • Data Engineer

    5 days ago

    chennai, India NTT DATA Services Full time

    Req ID:  269806  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in chennai, Tamil Nādu (IN-TN), India (IN). Azure Data Engineer, you will...

  • Senior Data Engineer

    2 months ago

    Chennai, India Epam Full time

    Description EPAM is a leading global provider of digital platform engineering and development services. We are committed to having a positive impact on our customers, our employees, and our communities. We embrace a dynamic and inclusive culture. Here you will collaborate with multi-national teams, contribute to a myriad of innovative projects that...

  • Data Engineer

    5 days ago

    Chennai, India NTT DATA Services Full time

    Req ID: 269806 NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now.We are currently seeking a Data Engineer to join our team in chennai, Tamil Nādu (IN-TN), India (IN).Azure Data Engineer, you will be...

  • Data Engineer

    3 days ago

    chennai, India NTT DATA Services Full time

    Req ID: 269806  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Data Engineer to join our team in chennai, Tamil Nādu (IN-TN), India (IN). Azure Data...

  • Senior Data Engineer

    2 weeks ago

    chennai, India ZoomInfo Full time

    Senior Data Engineer Position: Senior Data Engineer Location: Chennai Experience : 7-10 Years About the Role: Join our Product Data Monitoring team as a Data Engineer, where you play a pivotal role in enhancing and architecting the strategy behind our data monitoring and quality assurance systems. In this dynamic position, you'll serve as both a...

  • Senior Data Engineer

    2 weeks ago

    Chennai, India ZoomInfo Full time

    Senior Data EngineerPosition: Senior Data EngineerLocation: ChennaiExperience : 7-10 Years About the Role:Join our Product Data Monitoring team as a Data Engineer, where you play a pivotal role in enhancing and architecting the strategy behind our data monitoring and quality assurance systems. In this dynamic position, you'll serve as both a developer and...

  • Senior Data Engineer

    1 month ago

    Chennai, India Snaphunt Full time

    The OfferSenior roleThe JobYou will be responsible for:Developing scripts to process structured and unstructured data.Recommending, developing and implementing ways to improve data reliability, efficiency and quality.Supporting translation of data business needs into technical system requirements.Working with stakeholders to understand needs in order with...