Lead Data Engineer

1 month ago

coimbatore, India Recmatrix Consulting Full time

Job Title: Tech Lead - BigData, Digital Business

Location: Remote within India

Employment Type: Contract

Experience Level: 8+ years


Position Overview:


We are seeking a Tech Lead - BigData, Digital Businesst to join our Digital Business team. This role involves building and managing data warehouses to support various business functions such as Sales, Marketing, and Content teams, along with driving best practices in Data engineering, Data Modeling, ETL, SQL and AWS Cloud services.


Key Responsibilities:

• Supporting Multiple ongoing and future big data projects in this fast paced environment

• Solving big data problems by structuring and analyse the behaviour of data using a various data technology and tools

• Handle large scale database, analysing the patterns of data to make strong and accurate business decisions.

• Benchmark systems, analyse system bottlenecks and propose solutions to eliminate them, be able to clearly articulate pros and cons of various

technologies and platforms.

• Build & manage the data pipelines for billions of event in OTT domain is plus.

• Code review and Mentor team members.


Required Skills and Experience:

  • Bachelor’s degree in Computer Science, Information Technology, or a related field.
  • Overall 8+ years of IT experience with 5+ years in Data related technologies, and expertise of 3+ years in data-related AWS Cloud services

• Have 3+ year of experience in ClickHouse or any other OLAP system

• Mandatory to have knowledge of Big Data Architecture Patterns and experience in the delivery of end-to-end Big Data solutions.

• Expert in programming languages like Java/ Scala and good to have Python

• Worked on at least one distributed data processing framework: Spark (Core, Streaming, SQL), Storm or Flink, etc.

• Worked in Hadoop eco-system with AWS cloud distribution and worked at least on one or more big data ingestion tools (Sqoop, Flume, NiFI, etc),

distributed messaging and ingestion frameworks (Kafka, Pulsar, Pub/Sub, etc) and good to know traditional tools like Informatica, Talend etc

  • • Good Exposure in development with CI / CD pipelines. Knowledge of containerization, orchestration and kubernetes engine would be an added advantage.

  • Lead Data Engineer

    1 month ago

    Coimbatore, Tamil Nadu, India Presidio Full time

    Unlock Your Potential as a Lead Data Engineer at PresidioAre you ready to take your career to the next level and join a team of innovators who are shaping the future of technology? We're seeking a talented Lead Data Engineer to design, develop, and oversee data systems on the Microsoft Azure cloud platform.About the RoleAs a Lead Data Engineer at Presidio,...

  • Lead Data Engineer

    8 months ago

    Coimbatore, India Presidio Full time

    SEIZE THE OPPORTUNITY TO BE A PART OF SOMETHING GREAT! Presidio is on the leading edge of a technology-driven movement to transform the way business is done, for our customers and our customers' customers. Joining Presidio means immersing yourself in a culture of self-starters, collaborators and innovators who make real, lasting change in the marketplace...

  • Lead Data Architect for Cloud Data Warehousing

    2 weeks ago

    Coimbatore, Tamil Nadu, India Value Momentum Software Services Pvt. Ltd. Full time

    Job OverviewWe are seeking a highly skilled Lead Data Architect to join our team at Value Momentum Software Services Pvt. Ltd. This is an exciting opportunity for a seasoned professional to lead the design and implementation of data solutions using Snowflake.About the JobThe ideal candidate will have a solid background in data architecture, cloud data...

  • Lead Consultant – Data

    4 months ago

    Coimbatore, India Fluidata Analytics Full time

    Experience:Minimum 5 years of experience with BI and Data Warehouse and minimum 2 years managing/ leading the team. About Fluidata:Fluidata Analytics is a modern data and analytics consultancy firm. Our team of experts provides end-to-end data engineering and analytics services to clients by using cutting-edge data technology and methodologies.  Job...

  • Data Scientist

    4 weeks ago

    Coimbatore, Tamil Nadu, India Sense7ai Data Solution Pvt Ltd Full time

    Job Title: Data Scientist - Machine Learning ExpertJob Overview:We are seeking a highly skilled Data Scientist to support our products, sales, leadership, and marketing teams with data-driven insights. The ideal candidate will have expertise in machine learning, data analysis, and statistical modeling. Responsibilities:• Collaborate with engineering and...

  • Data Engineering Manager

    4 weeks ago

    Coimbatore, Tamil Nadu, India Cloud Destinations Full time

    About the Role:We are seeking a highly skilled Senior Data Engineering Manager to join our team at Cloud Destinations. This is a challenging and rewarding opportunity for a seasoned professional to lead our data engineering efforts and drive business success through data-driven insights.Key Responsibilities:As a Senior Data Engineering Manager, you will be...

  • Data Engineering Lead/Architect

    2 months ago

    Coimbatore, India QBrainX Full time

    Job Title : Data Engineering Lead / Architect (With Architecture Experience is MUST)Exp level - 10+ yearsLocation : Coimbatore (Work From Office)Position Type : Full-TimeKey Responsibilities :Architect and Design Data Solutions :- Collaborate with cross-functional teams to understand business requirements and design scalable and efficient data solutions.-...

  • Data Engineering Lead

    1 month ago

    Anywhere in India/Multiple Locations/Hyderabad/Chennai/Kerala/Andhra Pradesh/Coimbatore QBrainX Full time

    Job Title: Data Engineering LeadWe are seeking a highly skilled Data Engineering Lead to join our team at QBrainX. As a key member of our data engineering team, you will play a crucial role in designing, developing, and maintaining our data pipelines.Key Responsibilities:Design and develop scalable data pipelines using Python and SQL.Develop and implement...

  • Senior Data Scientist

    1 week ago

    Coimbatore, India Wavicle Data Solutions Full time

    Primary Skills: computer vision, artificial intelligence, Python, R, SQL, or Bash.Secondary Skills: PyTorch, TensorFlow, and Keras.Location: Coimbatore/ChennaiRoles & Responsibilities• 5+ years of industry work experience in computer vision, object detection, pattern recognition, artificial intelligence, automation, and/or vision processing.• Experience...

  • Senior Cloud Data Engineer

    3 weeks ago

    Coimbatore, Tamil Nadu, India HTC Global Services Full time

    Key Responsibilities:a. Lead and guide the data engineering team technically and share best practices with the team.b. Excellent knowledge of SQL, Data Warehouse Architecture, Data Modelling and design concepts.c. Experience in Power BI, SFTP, Messaging, APIs and working in Agile delivery.d. Strong written and verbal communication skills.e. 8+ years of...

  • Lead Full Stack Engineer

    3 weeks ago

    Coimbatore, India Wavicle Data Solutions Full time

    - 7 + years of software development experience in .Net development.- 1 - 3 + years of software development experience in Angular JS or ReactJS or Vue JS.- Experience deploying software using CI/CD tools such as GitLab’s, Jenkins, Azure, GitBucket CI/CD, DevOps (GitLab preferred).- Demonstrated leadership on small to medium-scale projects impacting...

  • Senior data scientist

    4 days ago

    Coimbatore, India Wavicle Data Solutions Full time

    Primary Skills: computer vision, artificial intelligence, Python, R, SQL, or Bash. Secondary Skills: Py Torch, Tensor Flow, and Keras. Location: Coimbatore/Chennai Roles & Responsibilities • 5+ years of industry work experience in computer vision, object detection, pattern recognition, artificial intelligence, automation, and/or vision processing. ...

  • Senior data scientist

    1 week ago

    Coimbatore, India Wavicle Data Solutions Full time

    Primary Skills: computer vision, artificial intelligence, Python, R, SQL, or Bash.Secondary Skills: Py Torch, Tensor Flow, and Keras.Location: Coimbatore/ChennaiRoles & Responsibilities• 5+ years of industry work experience in computer vision, object detection, pattern recognition, artificial intelligence, automation, and/or vision processing.•...

  • Data Scientist to Drive Business Intelligence

    3 weeks ago

    Coimbatore, Tamil Nadu, India Sense7ai Data Solution Pvt Ltd Full time

    We are seeking a Data Scientist to drive business intelligence at Sense7ai Data Solution Pvt Ltd. As a key member of our team, you will be responsible for analyzing large datasets to gain valuable insights that inform our business decisions.Key Responsibilities:Collaborate with engineering and product development teams to align data science efforts with...

  • Healthcare Insurance Operations Lead

    1 week ago

    Coimbatore, Tamil Nadu, India NTT DATA Full time

    About the Role:NTT DATA is a leading IT services provider, and we are seeking an experienced Healthcare Insurance Operations professional to join our team. As a key member of our operations team, you will be responsible for ensuring seamless delivery of healthcare insurance services to our clients.Job Responsibilities:Key responsibilities include reading and...

  • Wavicle Data Solutions | Senior Data Scientist | coimbatore

    1 week ago

    coimbatore, India Wavicle Data Solutions Full time

    Primary Skills: computer vision, artificial intelligence, Python, R, SQL, or Bash. Secondary Skills: PyTorch, TensorFlow, and Keras. Location: Coimbatore/Chennai Roles & Responsibilities • 5+ years of industry work experience in computer vision, object detection, pattern recognition, artificial intelligence, automation, and/or vision processing. •...

  • Wavicle Data Solutions | Senior Data Scientist | coimbatore

    1 week ago

    coimbatore, India Wavicle Data Solutions Full time

    Primary Skills: computer vision, artificial intelligence, Python, R, SQL, or Bash. Secondary Skills: PyTorch, TensorFlow, and Keras. Location: Coimbatore/Chennai Roles & Responsibilities • 5+ years of industry work experience in computer vision, object detection, pattern recognition, artificial intelligence, automation, and/or vision processing. •...

  • Wavicle Data Solutions | Senior Data Scientist | coimbatore

    1 week ago

    coimbatore, India Wavicle Data Solutions Full time

    Primary Skills: computer vision, artificial intelligence, Python, R, SQL, or Bash.Secondary Skills: PyTorch, TensorFlow, and Keras.Location: Coimbatore/ChennaiRoles & Responsibilities• 5+ years of industry work experience in computer vision, object detection, pattern recognition, artificial intelligence, automation, and/or vision processing.• Experience...

  • Senior Data Scientist

    1 week ago

    Coimbatore, India Wavicle Data Solutions Full time

    Primary Skills: computer vision, artificial intelligence, Python, R, SQL, or Bash.Secondary Skills: PyTorch, TensorFlow, and Keras.Location: Coimbatore/ChennaiRoles & Responsibilities• 5+ years of industry work experience in computer vision, object detection, pattern recognition, artificial intelligence, automation, and/or vision processing.• Experience...

  • Senior Data Scientist

    1 week ago

    Coimbatore, India Wavicle Data Solutions Full time

    Primary Skills: computer vision, artificial intelligence, Python, R, SQL, or Bash.Secondary Skills: PyTorch, TensorFlow, and Keras.Location: Coimbatore/ChennaiRoles & Responsibilities• 5+ years of industry work experience in computer vision, object detection, pattern recognition, artificial intelligence, automation, and/or vision processing.• Experience...