Senior Data Engineer

2 weeks ago

Coimbatore, India USV PRIVATE LIMITED Full time

Overview:

As a Senior Data Engineer, you will play a pivotal role in designing, implementing, and maintaining the data infrastructure of our organization. You will be responsible for developing robust data pipelines, optimizing data workflows, and ensuring the reliability and scalability of our data systems. Collaboration with cross-functional teams including data scientists, software engineers, and business analysts will be essential to drive data-driven decision-making and support various business initiatives.


Responsibilities:


1. Data Pipeline Development:

- Design, build, and maintain scalable data pipelines to ingest, process, and transform large volumes of structured and unstructured data from diverse sources.

- Implement efficient ETL (Extract, Transform, Load) processes to ensure timely and accurate data delivery to downstream systems.

- Optimize data workflows for performance, reliability, and cost-effectiveness, leveraging technologies such as Apache Spark, Kafka, or similar distributed computing frameworks.


2. Data Modeling and Architecture:

- Develop and maintain data models, schemas, and metadata to support analytical and reporting requirements.

- Design and optimize data storage solutions including relational databases, NoSQL databases, data lakes, and data warehouses.

- Collaborate with data architects and infrastructure teams to ensure alignment with overall data architecture and best practices.


3. Data Quality and Governance:

- Implement data quality checks and validation processes to ensure data accuracy, consistency, and completeness.

- Establish and enforce data governance policies, standards, and procedures to maintain data integrity and compliance with regulatory requirements.

- Monitor data pipelines and proactively identify and resolve data quality issues or anomalies.


4. Performance Tuning and Optimization:

- Identify performance bottlenecks in data processing and storage systems and implement optimizations to improve throughput, latency, and resource utilization.

- Conduct capacity planning and scalability assessments to support growing data volumes and user demands.

- Collaborate with infrastructure teams to fine-tune hardware configurations and cloud resources for optimal performance.


5. Collaboration and Communication:

- Work closely with cross-functional teams including data scientists, software engineers, business analysts, and product managers to understand data requirements and deliver data solutions that meet business needs.

- Communicate effectively with stakeholders to gather requirements, provide project updates, and present insights derived from data analysis.

- Mentor junior data engineers and provide technical guidance and support as needed.


Qualifications:


- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.

- 8+ years of experience in data engineering roles, with a proven track record of designing and implementing data solutions at scale.

- Proficiency in programming languages such as Python, Java, or Scala, with experience in building data pipelines using frameworks like Apache Spark, Apache Beam, or similar.

- Strong SQL skills and experience working with relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., MongoDB, Cassandra).

- Hands-on experience with cloud platforms such as AWS, GCP, or Azure, including services like S3, EC2, EMR, Dataflow, BigQuery, or equivalent.

- Solid understanding of data modeling concepts, data warehousing principles, and ETL best practices.

- Familiarity with data governance frameworks, data quality tools, and regulatory requirements (e.g., GDPR, HIPAA).

- Excellent problem-solving skills and the ability to work effectively in a fast-paced, dynamic environment.

- Strong communication and collaboration skills, with the ability to interact with stakeholders at all levels of the organization.


Additional Preferred Skills:


- Experience with containerization and orchestration tools such as Docker, Kubernetes.

- Knowledge of stream processing frameworks like Apache Kafka, Apache Flink, or similar.

- Familiarity with machine learning and data science concepts.

- Certification in relevant technologies or cloud platforms (e.g., AWS Certified Big Data - Specialty, Google Professional Data Engineer).

  • Senior data scientist

    5 days ago

    Coimbatore, India Wavicle Data Solutions Full time

    Job Title: Senior Data Scientist We are seeking a highly skilled Senior Data Scientist with expertise in Generative AI, machine learning, and advanced data science techniques to join our dynamic team. This role involves collaborating with cross-functional teams to develop and deploy scalable AI solutions, driving innovation and business outcomes. ...

  • Senior data scientist

    2 weeks ago

    Coimbatore, India Wavicle Data Solutions Full time

    Job Title: Senior Data ScientistWe are seeking a highly skilled Senior Data Scientist with expertise in Generative AI, machine learning, and advanced data science techniques to join our dynamic team. This role involves collaborating with cross-functional teams to develop and deploy scalable AI solutions, driving innovation and business...

  • Senior Data Scientist

    2 weeks ago

    Coimbatore, India Wavicle Data Solutions Full time

    Job Title: Senior Data ScientistWe are seeking a highly skilled Senior Data Scientist with expertise in Generative AI, machine learning, and advanced data science techniques to join our dynamic team. This role involves collaborating with cross-functional teams to develop and deploy scalable AI solutions, driving innovation and business...

  • Senior Data Scientist

    2 weeks ago

    Coimbatore, India Wavicle Data Solutions Full time

    Job Title: Senior Data Scientist We are seeking a highly skilled Senior Data Scientist with expertise in Generative AI, machine learning, and advanced data science techniques to join our dynamic team. This role involves collaborating with cross-functional teams to develop and deploy scalable AI solutions, driving innovation and business outcomes....

  • Senior Data Scientist

    2 weeks ago

    Coimbatore, India Wavicle Data Solutions Full time

    Job Title: Senior Data ScientistWe are seeking a highly skilled Senior Data Scientist with expertise in Generative AI, machine learning, and advanced data science techniques to join our dynamic team. This role involves collaborating with cross-functional teams to develop and deploy scalable AI solutions, driving innovation and business...

  • Senior Data Scientist

    2 weeks ago

    Coimbatore, India Wavicle Data Solutions Full time

    Job Title: Senior Data ScientistWe are seeking a highly skilled Senior Data Scientist with expertise in Generative AI, machine learning, and advanced data science techniques to join our dynamic team. This role involves collaborating with cross-functional teams to develop and deploy scalable AI solutions, driving innovation and business...

  • Wavicle Data Solutions | Senior Data Scientist | coimbatore

    2 weeks ago

    coimbatore, India Wavicle Data Solutions Full time

    Job Title: Senior Data Scientist We are seeking a highly skilled Senior Data Scientist with expertise in Generative AI, machine learning, and advanced data science techniques to join our dynamic team. This role involves collaborating with cross-functional teams to develop and deploy scalable AI solutions, driving innovation and business outcomes....

  • Wavicle Data Solutions | Senior Data Scientist | coimbatore

    2 weeks ago

    coimbatore, India Wavicle Data Solutions Full time

    Job Title: Senior Data ScientistWe are seeking a highly skilled Senior Data Scientist with expertise in Generative AI, machine learning, and advanced data science techniques to join our dynamic team. This role involves collaborating with cross-functional teams to develop and deploy scalable AI solutions, driving innovation and business...

  • Clinical Data Analyst Senior Associate

    2 weeks ago

    Coimbatore, Tamil Nadu, India NTT DATA Full time

    About the RoleWe are seeking a highly skilled Clinical Data Analyst to join our team at NTT DATA as a Senior Associate. This individual will play a key role in supporting the analysis and coding of medical records.ResponsibilitiesThe successful candidate will be responsible for analyzing and coding medical records, ensuring accuracy and attention to detail...

  • Senior Data Engineer

    2 months ago

    Coimbatore, India QBrainX Inc Full time

    Job title - Senior Data EngineerExp - 6 to 8 yearsJob Location: Coimbatore / HyderabadDo you love building the infrastructure that fuels data-driven decision making? Are you passionate about wrangling raw data into a usable format? If so, then we want to hear from you!We are searching for a Senior Data Engineer to join our growing team. In this role, you...

  • Senior Data Scientist

    4 weeks ago

    Coimbatore, India Wavicle Data Solutions Full time

    Primary Skills: computer vision, artificial intelligence, Python, R, SQL, or Bash.Secondary Skills: PyTorch, TensorFlow, and Keras.Location: Coimbatore/ChennaiRoles & Responsibilities• 5+ years of industry work experience in computer vision, object detection, pattern recognition, artificial intelligence, automation, and/or vision processing.• Experience...

  • Senior data scientist

    3 weeks ago

    Coimbatore, India Wavicle Data Solutions Full time

    Primary Skills: computer vision, artificial intelligence, Python, R, SQL, or Bash. Secondary Skills: Py Torch, Tensor Flow, and Keras. Location: Coimbatore/Chennai Roles & Responsibilities • 5+ years of industry work experience in computer vision, object detection, pattern recognition, artificial intelligence, automation, and/or vision processing. ...

  • Senior data scientist

    3 weeks ago

    Coimbatore, India Wavicle Data Solutions Full time

    Primary Skills: computer vision, artificial intelligence, Python, R, SQL, or Bash.Secondary Skills: Py Torch, Tensor Flow, and Keras.Location: Coimbatore/ChennaiRoles & Responsibilities• 5+ years of industry work experience in computer vision, object detection, pattern recognition, artificial intelligence, automation, and/or vision processing.•...

  • Senior Data Scientist

    4 weeks ago

    Coimbatore, India Wavicle Data Solutions Full time

    Primary Skills: computer vision, artificial intelligence, Python, R, SQL, or Bash.Secondary Skills: PyTorch, TensorFlow, and Keras.Location: Coimbatore/ChennaiRoles & Responsibilities• 5+ years of industry work experience in computer vision, object detection, pattern recognition, artificial intelligence, automation, and/or vision processing.• Experience...

  • Senior Data Scientist

    4 weeks ago

    Coimbatore, India Wavicle Data Solutions Full time

    Primary Skills: computer vision, artificial intelligence, Python, R, SQL, or Bash.Secondary Skills: PyTorch, TensorFlow, and Keras.Location: Coimbatore/ChennaiRoles & Responsibilities• 5+ years of industry work experience in computer vision, object detection, pattern recognition, artificial intelligence, automation, and/or vision processing.• Experience...

  • Senior Data Engineer

    3 days ago

    Coimbatore, Tamil Nadu, India DOTCOD Full time

    **Job Summary:**We are seeking a highly skilled Senior Data Engineer to join our team at Dotcod. This role is ideal for an experienced professional who has a strong background in cloud data engineering and can design, build, and maintain complex data pipelines.About Dotcod:Dotcod is a leading provider of data engineering solutions. Our team is dedicated to...

  • Senior data analyst

    2 months ago

    Coimbatore, India DMAIC Academy & Consultancy Full time

    Job Title: Senior Data Analyst - Operations (Saa S) Job Summary: As the Senior Data Analyst - Operations in a Saa S environment, you will harness data to enhance operational efficiency, support strategic decisions, and drive overall business success. Working with cross-functional teams—including product, marketing, sales, customer success, finance, and...

  • Senior Data Analyst

    2 months ago

    Coimbatore, India DMAIC Academy & Consultancy Full time

    Job Title: Senior Data Analyst - Operations (SaaS) Job Summary: As the Senior Data Analyst - Operations in a SaaS environment, you will harness data to enhance operational efficiency, support strategic decisions, and drive overall business success. Working with cross-functional teams—including product, marketing, sales, customer success, finance, and...

  • Wavicle Data Solutions | Senior Data Scientist | coimbatore

    4 weeks ago

    coimbatore, India Wavicle Data Solutions Full time

    Primary Skills: computer vision, artificial intelligence, Python, R, SQL, or Bash.Secondary Skills: PyTorch, TensorFlow, and Keras.Location: Coimbatore/ChennaiRoles & Responsibilities• 5+ years of industry work experience in computer vision, object detection, pattern recognition, artificial intelligence, automation, and/or vision processing.• Experience...

  • Wavicle Data Solutions | Senior Data Scientist | coimbatore

    4 weeks ago

    coimbatore, India Wavicle Data Solutions Full time

    Primary Skills: computer vision, artificial intelligence, Python, R, SQL, or Bash. Secondary Skills: PyTorch, TensorFlow, and Keras. Location: Coimbatore/Chennai Roles & Responsibilities • 5+ years of industry work experience in computer vision, object detection, pattern recognition, artificial intelligence, automation, and/or vision processing. •...