Senior Data Engineer

1 month ago

ChennaiAny Location, IN mlesystems Full time

Job Title: Senior Data Engineer - Airflow

Location: Chennai (Remote)

Company Overview:


MLE Systems is a leading provider of advanced data analytics solutions, empowering businesses to harness the power of data for informed decision-making.

We specialize in developing cloud-based platforms and cutting-edge technologies to drive actionable insights.

We seek a talented Senior Data Engineer with expertise in Airflow, AWS, Python, SQL, and Spark to join our innovative team.


Job Description:

We are seeking a Senior Data Engineer with 6 to 8 years of experience to lead the design, development, and optimization of data pipelines and workflows utilizing Apache Airflow on AWS.

As a key member of our data engineering team, you will play a crucial role in architecting scalable solutions and ensuring the efficient processing and delivery of data for our clients.

Responsibilities:

- Design, implement, and manage robust data pipelines using Apache Airflow on AWS infrastructure.

- Develop and maintain ETL processes to extract, transform, and load data from diverse sources into data lakes and warehouses.

- Collaborate closely with cross-functional teams to understand data requirements and translate them into technical solutions.

- Optimize data pipeline performance and reliability to meet SLAs and business objectives.

- Troubleshoot and resolve issues related to data pipeline failures or performance bottlenecks.

- Implement best practices for data quality, data governance, and security throughout the data lifecycle.

- Stay abreast of emerging technologies and industry trends in data engineering and cloud computing.

Requirements:

- Bachelor's degree in Computer Science, Engineering, or a related field.

- 6 to 8 years of hands-on experience in data engineering roles, with a focus on building scalable data pipelines and workflows.

- Proficiency in Python programming and SQL for data manipulation and analysis.

- Strong working knowledge of AWS services such as S3, EC2, Glue, Redshift, Athena, and EMR.

- Extensive experience with Apache Airflow for orchestrating and scheduling complex data workflows.

- Familiarity with big data technologies such as Apache Spark for distributed data processing.

- Solid understanding of data modeling concepts and database design principles.

- Excellent problem-solving skills and attention to detail.

- Effective communication and collaboration skills in a team environment.

Preferred Qualifications:

- Master's degree in Computer Science, Engineering, or a related field.

- AWS certification in relevant specialties (e.g., AWS Certified Data Analytics - Specialty).

- Experience with containerization technologies such as Docker and Kubernetes.

- Knowledge of streaming data processing frameworks like Apache Kafka or AWS Kinesis.

- Familiarity with data visualization tools such as Tableau or Power BI.

Join us at MLE Systems and contribute to building innovative data analytics solutions that drive business success.

Apply now to become a part of our dynamic and talented team

(ref:hirist.tech)

  • Senior Machine Learning Engineer

    2 months ago

    Any Location, IN K2 Data & Analytics Full time

    Job Description : We are on the lookout for an enthusiastic ML Engineer with over five years of experience to be part of our team, which is focused on developing cutting-edge Video Ad Data technologies. The perfect fit for this role would be someone with a solid grasp of machine learning algorithms and a background in designing and executing large-scale...

  • Senior Machine Learning Engineer

    3 weeks ago

    Any Location, IN K2 Data & Analytics Full time

    Job Description : We are on the lookout for an enthusiastic ML Engineer with over five years of experience to be part of our team, which is focused on developing cutting-edge Video Ad Data technologies. The perfect fit for this role would be someone with a solid grasp of machine learning algorithms and a background in designing and executing large-scale...

  • Senior Data Engineer

    3 weeks ago

    Any Location, IN Innova ESI Full time

    About the Role :We are seeking a highly skilled and experienced Senior Data Engineer to join our growing team. This is a remote-first position, offering you the flexibility to work from anywhere while collaborating effectively with colleagues. In this role, you will play a key role in the entire data lifecycle, from designing and implementing data pipelines...

  • SportsGameX - Senior Data Engineer - ETL

    5 days ago

    Any Location, IN SportsGameX Full time

    SportsGameX is seeking a highly skilled and experienced Senior Data Engineer to join our data team. This is an exciting opportunity to play a key role in designing and implementing robust data pipelines for our advanced analytics and machine learning applications.Position Overview : As a Senior Data Engineer, you will be responsible for architecting,...

  • Senior Backend Engineer

    2 months ago

    Any Location, IN K2 Data & Analytics Full time

    Job Description :Join our team in crafting the future of media with our cutting-edge platforms and technologies. We're on the lookout for highly motivated senior software engineers with a knack for building innovative software. If you're passionate about leveraging ML, search, and recommendation algorithms while mastering distributed architectures,...

  • Senior Backend Engineer

    3 weeks ago

    Any Location, IN K2 Data & Analytics Full time

    Job Description :Join our team in crafting the future of media with our cutting-edge platforms and technologies. We're on the lookout for highly motivated senior software engineers with a knack for building innovative software. If you're passionate about leveraging ML, search, and recommendation algorithms while mastering distributed architectures,...

  • Senior Data Engineer

    3 weeks ago

    Any Location, IN UNICO CONNECT PRIVATE LIMITED Full time

    Job Description :Key Responsibilities :- Understand the factories , manufacturing process , data availability and avenues for improvement- Brainstorm , together with engineering, manufacturing and quality problems that can be solved using the acquired data in the data lake platform.- Define what data is required to create a solution and work with...

  • Senior Machine Learning Engineer

    3 weeks ago

    Any Location, IN Tekvaly Full time

    Job Description :As a Senior Machine Learning Engineer, you will be responsible for leading the development and deployment of machine learning models. You will work closely with data scientists, data engineers, and other stakeholders to understand business requirements and translate them into scalable ML solutions.Key Responsibilities :Model Development and...

  • Senior Machine Learning Engineer

    3 weeks ago

    Any Location, IN Tekvaly Full time

    Job Description :As a Senior Machine Learning Engineer, you will be responsible for leading the development and deployment of machine learning models. You will work closely with data scientists, data engineers, and other stakeholders to understand business requirements and translate them into scalable ML solutions.Key Responsibilities :Model Development and...

  • Senior Data Engineer

    3 weeks ago

    Any Location, IN Muoro Full time

    Role & Responsibilities:- Design, architect, and develop code in a testable, scalable, and performant manner. - Work closely with Product Managers, Cross Product Engineers and Data Engineers to optimize and deliver innovative solutions. - Build a team that mines, analyzes, and transforms large [un]structured datasets, collaborating with analysts, data...

  • Senior Data Engineer

    2 months ago

    Any Location, IN Muoro Full time

    Role & Responsibilities:- Design, architect, and develop code in a testable, scalable, and performant manner. - Work closely with Product Managers, Cross Product Engineers and Data Engineers to optimize and deliver innovative solutions. - Build a team that mines, analyzes, and transforms large [un]structured datasets, collaborating with analysts, data...

  • Senior Data Engineer

    3 weeks ago

    Any Location, IN Coders Brain Technology Pvt. Ltd. Full time

    Position Name : Sr Data EngineerExperience Required : 8+yearsSalary : As per the Market Standard or Else whatever budget you haveNotice period : Immediate joiner Job Type : Full timeLocation : RemoteJob Description :Solution Architect (Databricks) :Candidate having 8+ years of total experience in Data engineering (development/design), in which at least 5+...

  • Senior Data Engineer

    3 weeks ago

    Any Location, IN Coders Brain Technology Pvt. Ltd. Full time

    Position Name : Sr Data EngineerExperience Required : 8+yearsSalary : As per the Market Standard or Else whatever budget you haveNotice period : Immediate joiner Job Type : Full timeLocation : RemoteJob Description :Solution Architect (Databricks) :Candidate having 8+ years of total experience in Data engineering (development/design), in which at least 5+...

  • Senior Data Engineer

    2 months ago

    Bangalore/Any Location, IN Randstad Full time

    Job Description:We are looking for a highly skilled Senior Data Engineer with over 5 years of experience in the data engineering field. The ideal candidate will have strong expertise in PySpark, SQL databases, and Big Data programming for data transformation and aggregations. This role offers an exciting opportunity to work on cutting-edge projects,...

  • Senior Data Engineer

    3 weeks ago

    Bangalore/Any Location, IN Randstad Full time

    Job Description:We are looking for a highly skilled Senior Data Engineer with over 5 years of experience in the data engineering field. The ideal candidate will have strong expertise in PySpark, SQL databases, and Big Data programming for data transformation and aggregations. This role offers an exciting opportunity to work on cutting-edge projects,...

  • Harmony Data Integration Technologies

    1 month ago

    Any Location/Bangalore, IN Harmony Data Integration Technologies Pvt. Ltd. Full time

    Job Description :We are seeking an experienced and proactive Senior DevOps Engineer with a strong background in Azure to join our dynamic team. The ideal candidate is not only a technical expert but also possesses excellent communication and problem-solving skills. As a Senior DevOps Engineer, you will work as support engineer and play a crucial role in...

  • Senior Data Engineer

    5 days ago

    Any Location, IN Narwal Full time

    Job Description : Narwal, with its Global Delivery Model, strategically expands its reach across North America, the United Kingdom, and an offshore development center in India. Delivery cutting edge AI, Data, Cloud and Quality Engineering solutions and consistently surpassing expectations,Narwal has achieved remarkable triple-digit growth rates year after...

  • Data Visualization Engineer

    2 months ago

    Any Location, IN Mobile Programming LLC Full time

    Job Description : Mobile Programming is urgently hiring for a Data visualization Engineer who is responsible for the graphical representation of information and data. To be successful in this field, you must have knowledge of visual elements like charts, graphs, and maps, data visualization tools provide an accessible way to see and understand trends,...

  • Data Visualization Engineer

    3 weeks ago

    Any Location, IN Mobile Programming LLC Full time

    Job Description : Mobile Programming is urgently hiring for a Data visualization Engineer who is responsible for the graphical representation of information and data. To be successful in this field, you must have knowledge of visual elements like charts, graphs, and maps, data visualization tools provide an accessible way to see and understand trends,...

  • MLOps Developer

    1 month ago

    Any Location, IN GOOGNU DATA SERVICES PRIVATE LIMITED Full time

    Job Description :- Design and Implement MLOps Infrastructure: Build and maintain robust MLOps workflows using Azure Machine Learning and other Azure services to automate machine learning lifecycle from data preparation to model deployment and monitoring.- Collaborate with Cross-Functional Teams: Work closely with data scientists, software developers, and IT...