Data Engineer

2 days ago


Madurai, India ACL Digital Full time

Technical skills and core competencies

  1. Hands-on experience on Spark / PySpark is a must.
  2. Expertise with SQL is a must. An ability to understand and manipulate intermediate to complex level of SQL queries for Data warehouse, optimize queries is required.
  3. Hands-on experience in Data modelling is required.
  4. Hands-on experience in Lakehouse / Iceberg / Parquet required.
  5. Understanding of data manipulation libraries in python like Pandas, Polars, DuckDB is desired
  6. Hands-on experience in python is a must. Able to develop backend services using various python frameworks that expose REST APIs and integrate with SaaS services
  7. Hands on experience working with docker, building custom images for data pipelines is a must.
  8. Must have knowledge on AWS Cloud Platform. Managed Data services such as Kinesis, S3, EMR, AWS Glue
  9. Good hands-on on Linux OR any other similar distributions, viz. Ubuntu, CentOS, RHEL/RedHat, etc.
  10. Experience with building streaming and batch pipelines
  11. Experience in creating, and optimizing, data models suited for data analysts used in BI tools such as Tableau.
  12. Experience with DBT or Dataform is desirable.
  13. Experience with Kubernetes is good to have.

Responsibilities

  • Participate in the design and help drive the implementation of our data platform based on AWS Cloud.
  • Design, implement, and operate streaming and batch pipelines that scale.
  • Handle developing services, connecting dots by writing scripts in Python using various libraries and python frameworks.
  • Partner with both engineers and data analysts to build reliable datasets that can be trusted, understood, and used by the rest of the company.
  • Familiarity with data orchestration (Apache Airflow, Dagster, Prefect or any current orchestration tool)
  • Embrace a fast-paced start-up environment.
  • You should be passionate about your job and enjoy a fast-paced international working environment.
  • Background or experience in the telecom industry is a plus but not a requirement.
  • Love automating and enjoy monitoring



  • Madurai, India Senior Data Integration Engineer Full time

    Must Have Skills/Skill Requirement:Design and architect integration solutions to connect various enterprise applications, systems, and databases.Develop and implement integration workflows, APIs, and data pipelines to enable smooth communication and data exchange between different applications.Utilize Azure Integration Services such as Azure Logic Apps,...


  • Madurai, Tamil Nadu, India Kevell Guru Full time

    About Kevell GuruKevell Guru is a cutting-edge organization at the forefront of data engineering and analysis.Salary InformationWe offer an attractive salary package for this role, estimated to be around $80,000 - $110,000 per annum, commensurate with experience and location.Data Engineering RoleWe are seeking a skilled Azure Data Engineer to join our team....


  • Madurai, Tamil Nadu, India Fluidata Analytics Full time

    About UsFluidata Analytics is a cutting-edge data and analytics consultancy firm, providing end-to-end data engineering and analytics services to clients using modern data technologies and methodologies.Job OverviewWe are seeking an experienced Data Engineering Lead Consultant to manage the delivery of complex data engineering projects and lead...

  • Azure Data Engineer

    2 months ago


    Madurai, India Kevell Guru Full time

    TasksHandsonexperience working with Azure tools andtechnologiesMentorship from industry expertsin data engineering and analysisNetworkingopportunities with professionals in the fieldApathway to secure a placement withus!RequirementsFreshers/CollegeStudents/Career gap candidates can also eligible to applyThere is no arrears before enrolling and alsothe...

  • Azure Data Engineer

    2 months ago


    Madurai, India Kevell Guru Full time

    TasksHands-on experience working with Azure tools and technologiesMentorship from industry experts in data engineering and analysisNetworking opportunities with professionals in the fieldA pathway to secure a placement with us!RequirementsFreshers/College Students/Career gap candidates can also eligible to apply There is no arrears before enrolling and also...


  • Madurai, India Samay Consulting Full time

    At Samay India, we are looking to build a Centre of Excellence for our BI team and are actively looking to hire Azure Data Engineers in both Architect and Senior level developer roles. Prior experience building pipelines and transforming data using Azure Data Factory is mandatory. Knowledge of a Cloud Datawarehouse like Azure Synapse or Snowflake is also...

  • Azure Data Engineer

    2 months ago


    Madurai, Tamil Nadu, India Kevell Guru Full time

    Key ResponsibilitiesDevelop and implement data engineering solutions using Azure tools and technologies.Mentor and guide junior team members in data engineering and analysis.Collaborate with professionals in the field to drive innovation and growth.Contribute to the development of a data-driven culture within the organization.RequirementsFresh graduates,...


  • Madurai, Tamil Nadu, India Cardinal Health Full time

    Job OverviewWe are seeking an experienced Data Engineer to join our SAS Revenue Management team at Cardinal Health. This is an agile team focused on building & maintaining various financial engines in SAS for the Revenue Management team of Finance.About the RoleThis role is critical for the success of supporting our sales organizations and delivering best in...


  • Madurai, Tamil Nadu, India Waii Full time

    We are seeking a highly skilled Cloud Engineer to join our team at Waii. In this role, you will have the opportunity to work on cutting-edge projects that bring together the best of database technology and artificial intelligence.With a strong background in cloud development and experience with AWS, GCP, or Azure, you will be responsible for designing and...

  • Data Scientist

    4 weeks ago


    Madurai, Tamil Nadu, India Huptech HR Solutions Full time

    Job Title: Data EngineerAbout Huptech HR SolutionsHuptech HR Solutions is a leading technology company that provides innovative solutions to clients across the globe. We are seeking a highly skilled Data Engineer to join our team.About the RoleWe are looking for a Data Engineer to design, develop, and maintain scalable and efficient data pipelines using...


  • Madurai, India Wavicle Data Solutions Full time

    Job Summary:The AWS DevOps Engineer is responsible for provisioning, operating, and managing AWS cloud environments. They work with development, operations, and security teams to deploy, operate, and scale AWS environments. They are also responsible for automating and improving the AWS environment.Responsibilities- Assists in defining automated monitoring,...

  • Data Engineer

    4 weeks ago


    Madurai, India Truelancer.com Full time

    Job Title: Data Engineer (Gen AI)Must Have Skills: Gen AI, Python, AzureExp: 5-8 YrsStrong experience in Python programming language - Must.Experience in REST APIs, Fast APIs, Graph APIs, SQL Alchemy.Good experience in Azure Services like DataLake, Azure SQL, Function App, Azure Cognitive Search.Good Understanding on Chunking, Embeddings, vectorization,...


  • Madurai, India Dautom Full time

    Client Introduction:In this role, you will have the opportunity to work closely with one of our esteemed clients. This client is a global leader in the industry, known for its commitment to quality and innovation. They have chosen Dautom as their trusted partner for their upcoming projects.Job Title: Senior Data EngineerJob DescriptionYears of experience: 4+...

  • Data Architect

    2 months ago


    madurai, India Velotio Technologies Full time

    Velotio Technologies is a product engineering company working with innovative startups and enterprises. We are a certified Great Place to Work® and recognized as one of the best companies to work for in India. We have provided full-stack product development for 110+ startups across the globe building products in the cloud-native, data engineering, B2B SaaS,...

  • Data Architect

    1 month ago


    Madurai, Tamil Nadu, India Art Technology and Software Full time

    About the role at Art Technology and SoftwareWe are seeking an experienced Data Architect to join our team in the payments space. The ideal candidate will have a strong understanding of payment processing systems, customer account management, and card issuance.Key ResponsibilitiesDesign and implement data models to support different domains of payment...

  • AWS Data Architect

    2 months ago


    Madurai, India HCLTech Full time

    AWS Data ArchitectJob location: Chennai and BangaloreJob description:We are seeking an experienced AWS Principal Data Architect to lead the migration of Hadoop DWH workloads from on-premise to AWS EMR. As an AWS Data Architect, you will be a recognized expert in cloud data engineering, developing solutions designed for effective data processing and...


  • madurai, India Fluidata Analytics Full time

    Experience:Minimum 5 years of experience with BI and Data Warehouse and minimum 2 years managing/ leading the team. About Fluidata:Fluidata Analytics is a modern data and analytics consultancy firm. Our team of experts provides end-to-end data engineering and analytics services to clients by using cutting-edge data technology and methodologies.  Job...

  • Data Scientist

    5 days ago


    Madurai, India Synechron Full time

    Good-day,We have immediate opportunity for Data Science Manager – 10+ years.Job Role: Data Science ManagerJob Location: Bangalore, GTPExperience- 10+ yearsNotice Period : Immediate to 60 daysAbout Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity and innovative...


  • Madurai, Tamil Nadu, India DBiz Full time

    Unlocking Business PotentialDBiz, a leading digital transformation partner, is seeking a skilled Senior Data Engineer to join our team. We're not just building software; we're crafting solutions that drive real impact and transform businesses.Job OverviewWe're proud of our record of accomplishment, having delivered over 150 projects for over 100 clients. Our...


  • Madurai, Tamil Nadu, India Kevell Guru Full time

    About Kevell GuruWe are a forward-thinking company that is always looking for talented individuals to join our team.Salary and BenefitsThe salary for this position is estimated to be around £40,000 - £60,000 per annum, depending on experience. In addition to a competitive salary, we offer a range of benefits including mentorship from industry experts,...