Senior Data Engineer

1 month ago

india mlesystems Full time

Job Title: Senior Data Engineer - Airflow

Location: Chennai (Remote)

Company Overview:


MLE Systems is a leading provider of advanced data analytics solutions, empowering businesses to harness the power of data for informed decision-making.

We specialize in developing cloud-based platforms and cutting-edge technologies to drive actionable insights.

We seek a talented Senior Data Engineer with expertise in Airflow, AWS, Python, SQL, and Spark to join our innovative team.


Job Description:

We are seeking a Senior Data Engineer with 6 to 8 years of experience to lead the design, development, and optimization of data pipelines and workflows utilizing Apache Airflow on AWS.

As a key member of our data engineering team, you will play a crucial role in architecting scalable solutions and ensuring the efficient processing and delivery of data for our clients.

Responsibilities:

- Design, implement, and manage robust data pipelines using Apache Airflow on AWS infrastructure.

- Develop and maintain ETL processes to extract, transform, and load data from diverse sources into data lakes and warehouses.

- Collaborate closely with cross-functional teams to understand data requirements and translate them into technical solutions.

- Optimize data pipeline performance and reliability to meet SLAs and business objectives.

- Troubleshoot and resolve issues related to data pipeline failures or performance bottlenecks.

- Implement best practices for data quality, data governance, and security throughout the data lifecycle.

- Stay abreast of emerging technologies and industry trends in data engineering and cloud computing.

Requirements:

- Bachelor's degree in Computer Science, Engineering, or a related field.

- 6 to 8 years of hands-on experience in data engineering roles, with a focus on building scalable data pipelines and workflows.

- Proficiency in Python programming and SQL for data manipulation and analysis.

- Strong working knowledge of AWS services such as S3, EC2, Glue, Redshift, Athena, and EMR.

- Extensive experience with Apache Airflow for orchestrating and scheduling complex data workflows.

- Familiarity with big data technologies such as Apache Spark for distributed data processing.

- Solid understanding of data modeling concepts and database design principles.

- Excellent problem-solving skills and attention to detail.

- Effective communication and collaboration skills in a team environment.

Preferred Qualifications:

- Master's degree in Computer Science, Engineering, or a related field.

- AWS certification in relevant specialties (e.g., AWS Certified Data Analytics - Specialty).

- Experience with containerization technologies such as Docker and Kubernetes.

- Knowledge of streaming data processing frameworks like Apache Kafka or AWS Kinesis.

- Familiarity with data visualization tools such as Tableau or Power BI.

Join us at MLE Systems and contribute to building innovative data analytics solutions that drive business success.

Apply now to become a part of our dynamic and talented team

(ref:hirist.tech)

  • Operations Specialist

    1 month ago

    India Data Engineer Academy Full time

    Job Title: Operations Analyst Location : RemoteCompany Overview:Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary to...

  • Operations Specialist

    4 weeks ago

    india Data Engineer Academy Full time

    Job Title: Operations Analyst Location : Remote Company Overview: Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary...

  • Operations Specialist

    4 weeks ago

    india Data Engineer Academy Full time

    Job Title: Operations Analyst Location : Remote Company Overview: Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary...

  • Operations Specialist

    6 days ago

    India Data Engineer Academy Full time

    Job Title: Operations Analyst Location : Remote Company Overview: Data Engineering Academy is a pioneering force in data engineering education, founded by FAANG data engineers with extensive industry expertise. Our platform provides comprehensive programs tailored to empower aspiring data engineers, equipping them with the skills and confidence necessary...

  • Senior Machine Learning Engineer

    6 days ago

    India K2 Data & Analytics Full time

    Job Title: Senior Machine Learning EngineerWe are currently seeking a highly motivated Senior Machine Learning Engineer with extensive experience exceeding five years to join our dynamic team dedicated to leading the way in innovative Video Ad Data solutions.The ideal candidate for this position should possess a strong knowledge of machine learning...

  • Senior Data Engineer

    3 weeks ago

    india RoundCircle Full time

    Round Circle is a leading technology company dedicated to leveraging data-driven insights to fuel innovation and drive business growth. We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will play a pivotal role in designing, developing, and optimizing our data infrastructure,...

  • Senior Data Engineer

    6 days ago

    India Next-Link Full time

    Job Description Senior Data Engineer - Brussels - 12 moisOne of our important clients is currently looking for a Senior Data Engineer for a 12-month contract in Brussels.We are looking for a Senior Data Engineer who has extensive experience in developing and deploying data pipelines, infrastructure, and models for our data science projects. You will work...

  • Senior Data Engineer

    6 days ago

    India Mopid Full time

    Senior Data Engineer Position Experience Range: 4-8 years Job Timing: This position is full-time Job Type: The role requires working in-office from our Hyderabad location. If you are passionate about leveraging data to drive business success, have a keen eye for detail, and are looking for an opportunity to bring your expertise to a vibrant team, we would...

  • Senior Data Engineer

    6 days ago

    India hunterAI Full time

    Company Description Join hunterAI, a leading provider of advanced data-driven solutions, specializing in OCR, ML, Python, MySQL, Data Analysis, and NLP. As a remote-first company, we foster a collaborative and inclusive work environment, prioritizing work-life balance. Explore how we leverage cutting-edge technologies to drive business success through data...

  • Senior Data Engineer

    6 days ago

    India Rigel Networks Pvt. Ltd. Full time

    Role Description:This is role for a Senior Data Engineer specializing in PySpark, Python, and SQL.As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data infrastructure and pipelines.You will collaborate with cross-functional teams to analyze data requirements, develop data models, and implement data...

  • Senior Data Engineer

    2 months ago

    India hunterAI Full time

    Company DescriptionJoin hunterAI, a leading provider of advanced data-driven solutions, specializing in OCR, ML, Python, MySQL, Data Analysis, and NLP. As a remote-first company, we foster a collaborative and inclusive work environment, prioritizing work-life balance. Explore how we leverage cutting-edge technologies to drive business success through data...

  • Senior Data Engineer

    1 month ago

    India hunterAI Full time

    Company Description Join hunterAI, a leading provider of advanced data-driven solutions, specializing in OCR, ML, Python, MySQL, Data Analysis, and NLP. As a remote-first company, we foster a collaborative and inclusive work environment, prioritizing work-life balance. Explore how we leverage cutting-edge technologies to drive business success through data...

  • Senior Data Engineer

    4 weeks ago

    india OTSI Full time

    Job Description Object Technology Solutions, Inc (OTSI) has an immediate opening for a Senior Data Engineer. Senior Data Engineer (Irving, Tx) JOB DESCRIPTION:• Analyze and understand  data sources & APIs• Design and Develop methods to connect & collect data from different data sources• Design and Develop methods to filter/cleanse the data•...

  • Senior Data Engineer

    3 weeks ago

    india OTSI Full time

    Job Description Object Technology Solutions, Inc (OTSI) has an immediate opening for a Senior Data Engineer. Senior Data Engineer (Irving, Tx) JOB DESCRIPTION:• Analyze and understand  data sources & APIs• Design and Develop methods to connect & collect data from different data sources• Design and Develop methods to filter/cleanse the data•...

  • Senior Data Engineer

    6 days ago

    India Accelerant Full time

    Job Type: ContractLocation: IndiaExperience: 8+ yearsRequired Experience:Hands-on experience with Fivetran, AWS S3, DBT, Redshift, and TableauRole Description:We are looking for a Senior Data Engineer to join our team at Accelerant. As a Senior Data Engineer, you will play a crucial role in data modeling, ETL processes, data warehousing, and data analytics....

  • Senior Data Engineer

    4 weeks ago

    India Accelerant Full time

    Job Type - ContractLocation- IndiaExperience - 8+ yearsNOTE - Must have hands on Experience in : Fivetran , AWS S3 , DBT , Redshift and Tableau.Role DescriptionThis is a remote contract role for a Senior Data Engineer at Accelerant. As a Senior Data Engineer, you will be responsible for the day-to-day tasks associated with data engineering, including data...

  • Senior Data Engineer

    4 weeks ago

    india Accelerant Full time

    Job Type - Contract Location- India Experience - 8+ years NOTE - Must have hands on Experience in : Fivetran , AWS S3 , DBT , Redshift and Tableau. Role Description This is a remote contract role for a Senior Data Engineer at Accelerant. As a Senior Data Engineer, you will be responsible for the day-to-day tasks associated with data engineering,...

  • Senior Data Engineer

    6 days ago

    India Accelerant Full time

    Job Type - Contract Location- India Experience - 8+ years NOTE - Must have hands on Experience in : Fivetran , AWS S3 , DBT , Redshift and Tableau. Role Description This is a remote contract role for a Senior Data Engineer at Accelerant. As a Senior Data Engineer, you will be responsible for the day-to-day tasks associated with data engineering,...

  • Senior Data Engineer

    1 month ago

    india PrimEra Medical Technologies Full time

    Job Description: Senior Data Engineer About PrimEra: PrimEra is a leading innovator in the healthcare industry, committed to transforming healthcare operations through advanced data solutions. We foster a collaborative and inclusive environment where professionals can grow and make a significant impact. Position Overview: We are seeking a highly skilled...

  • Senior Data Engineer

    1 month ago

    india True Tech Professionals Full time

    Senior Data Engineer Location: Gurgaon (Hybrid Mode) Experience: 5 years and above. Immediate Joiners Preferred (Notice Period: 10 - 15 days) We are seeking a skilled Senior Data Engineer to join our dynamic team. The ideal candidate should have a strong background in data engineering with expertise in Python, Pyspark, AWS Glue, Athena, Redshift, and SQL....