DataOps Engineer

2 months ago

India Andela Full time

DataOps Engineer (AWS)

Andela

Location Requirement: India


About Andela

Andela exists to connect brilliance and opportunity. Since 2014, we have been dedicated to breaking down global barriers and accelerating the future of work for both technologists and organizations around the world. For technologists, Andela offers competitive long-term career opportunities with leading organizations, access to a global community of professionals, and educational opportunities with leading technology providers.


At Andela, we’re deeply passionate about creating long-lasting and transformative growth opportunities for all - and doing it in an E.P.I.C. way We’re excited to continue building our remote-first team with incredible people like you. After applying for this role, you will join our Andela Community of brilliant technologists by passing a technical screening and live interview. As a community member, you’ll have access to many exclusive technologist roles. Join Andela today to access this opportunity and more in our global marketplace


Our roles are typically filled at lightning speed, so if you’re considering applying, get your application in quickly


Andela´s Benefits:

-- 100% payment in USD.


About the role

Key Responsibilities:

  • Design, implement, and maintain the data pipeline infrastructure that ingests, stores, and processes large amounts of data.
  • Develop and maintain data quality checks, error handling procedures and recovery processes.
  • Ensure the reliability and performance of the data pipeline infrastructure and support its operation.
  • Collaborate with cross-functional teams to identify, design, and implement data solutions to meet business requirements.
  • Design and implement security and data access controls to ensure the privacy and protection of sensitive data.
  • Troubleshoot and resolve technical issues with the data pipeline infrastructure.
  • Document the data pipeline infrastructure, processes, and procedures for reference and training purposes.
  • Stay up-to-date with emerging trends and technologies in the field of data engineering and data operations.
  • Utilize DevOps tools such as Terraform to automate infrastructure deployment and management.

Qualifications

  • Bachelor's degree in computer science, Information Systems, or a related field
  • 5+ years of experience in DevOps or data engineering, data operations, or a related field
  • Knowledge of data quality, error handling, and recovery processes
  • Experience with AWS and its tools: Lambda, Redshift, Lake Formation, MSK, VPC (Endpoints, Gateway, Peering connections, Routing), Glue, SF, IAM
  • Terraform for infrastructure deployment and management
  • Github Actions as CI/CD
  • Python & Shell (at least scripting level knowledge)
  • Docker and containerization
  • Excellent problem-solving and analytical skills
  • Strong written and verbal communication skills
  • Ability to work in a fast-paced, dynamic environment

Preferred Qualifications

  • Kubernetes


Required skills

DevOps (4 - 6 yrs)

AWS (Amazon Web Services) (4 - 6 yrs)

Terraform (4 - 6 yrs)

Containerization (4 - 6 yrs)

Docker (4 - 6 yrs)

Shell Scripting (2 - 3 yrs)

Python (2 - 3 yrs)

Identity and Access Management (4 - 6 yrs)

Lambda (4 - 6 yrs)

Redshift (AWS) (4 - 6 yrs)


Optional skills

Kubernetes (4 - 6 yrs)


Must have: AWS and its tools: (Lambda, Redshift, Lake Formation, MSK, VPC (Endpoints, Gateway, Peering connections, Routing), Glue, SF, IAM), GitHub Actions, Python and Shell (scripting), Docker, DevOps, DataOps Nice to have: Kubernetes


Main job time zone: EST

Time zone overlap requirements: 5+ hours with EST (9 am - 2 pm)

Location Requirements: India

Working hours: Full-time dedication (8 hours/Day - 40 hours/week)


Important: this role requires in-person work once a quarter for a few days (approximately a week). Exact dates and location to be confirmed.


Device: Laptop to be provided by Andela (either shipped or stipend to purchase, in this case a receipt must be provided)


Offer

Estimated Duration: 12-month-term contractor position (Renewable)

Full-time dedication (40 hours/week)


At Andela, we know our strengths lie in our diverse community whose talents, perspectives, backgrounds, and orientations we take pride in. Andela is committed to nurturing a work environment where all individuals are treated with respect and dignity. Everyone has the right to work in a professional atmosphere that promotes equal employment opportunities and prohibits discriminatory practices. Andela provides equal employment opportunities to all employees and applicants without regard to factors including but not limited to race, color, religion, gender, sexual orientation, gender identity, national origin, age, disability, pregnancy (including breastfeeding), genetic information, HIV/AIDS or any other medical status, family or parental status, marital status, amnesty or status as a covered veteran in accordance with applicable federal, state and local laws. This commitment applies to all terms and conditions of employment, including but not limited to hiring, placement, promotion, termination, layoff, recall, transfer, leaves of absence, compensation, and training. Our policies expressly prohibit any form of harassment and/or discrimination, as stated above.


Andela is home for all. Come as you are.

  • Data Engineer

    3 weeks ago

    india GeoTech Full time

    About Us: We are an innovative technology company focused on delivering data-driven solutions that power our business operations and drive growth. We are looking for a skilled Data Engineer with deep expertise in Google Cloud solutions to join our team. This role is integral to building and maintaining our data infrastructure, ensuring scalability, security,...

  • Data Engineer

    3 weeks ago

    India GeoTech Full time

    About Us: We are an innovative technology company focused on delivering data-driven solutions that power our business operations and drive growth. We are looking for a skilled Data Engineer with deep expertise in Google Cloud solutions to join our team. This role is integral to building and maintaining our data infrastructure, ensuring scalability,...

  • Data Engineer

    2 months ago

    India GeoTech Full time

    About Us: We are an innovative technology company focused on delivering data-driven solutions that power our business operations and drive growth. We are looking for a skilled Data Engineer with deep expertise in Google Cloud solutions to join our team. This role is integral to building and maintaining our data infrastructure, ensuring scalability,...

  • Data Engineer

    2 months ago

    india GeoTech Full time

    About Us: We are an innovative technology company focused on delivering data-driven solutions that power our business operations and drive growth. We are looking for a skilled Data Engineer with deep expertise in Google Cloud solutions to join our team. This role is integral to building and maintaining our data infrastructure, ensuring scalability,...

  • Data Engineer

    2 weeks ago

    india GeoTech Full time

    About Us: We are an innovative technology company focused on delivering data-driven solutions that power our business operations and drive growth. We are looking for a skilled Data Engineer with deep expertise in Google Cloud solutions to join our team. This role is integral to building and maintaining our data infrastructure, ensuring scalability,...

  • Data Engineer

    2 months ago

    India GeoTech Full time

    About Us: We are an innovative technology company focused on delivering data-driven solutions that power our business operations and drive growth. We are looking for a skilled Data Engineer with deep expertise in Google Cloud solutions to join our team. This role is integral to building and maintaining our data infrastructure, ensuring scalability,...

  • Data Engineer

    2 months ago

    India GeoTech Full time

    About Us: We are an innovative technology company focused on delivering data-driven solutions that power our business operations and drive growth. We are looking for a skilled Data Engineer with deep expertise in Google Cloud solutions to join our team. This role is integral to building and maintaining our data infrastructure, ensuring scalability, security,...

  • DataOps Engineer

    2 months ago

    india Andela Full time

    DataOps Engineer (AWS) Andela Location Requirement: India About Andela Andela exists to connect brilliance and opportunity. Since 2014, we have been dedicated to breaking down global barriers and accelerating the future of work for both technologists and organizations around the world. For technologists, Andela offers competitive long-term career...

  • Robosoft Technologies

    1 month ago

    Anywhere in India/Multiple Locations, IN Robosoft Technologies Full time

    Position Title : DataOps EngineerLocation : RemoteJob Type : Contract - 3 months only. Please apply only if you are interested.Experience Required : 7+ YearsJob Summary :We are seeking a highly skilled and experienced DataOps Engineer to join our dynamic team. The ideal candidate will have a strong background in DataOps practices with a focus on Azure...

  • Data Ops Engineer

    4 days ago

    India Live Connections Full time

    Exp : 12yrs to 16yrs We are looking for a strong IC candidate who has strong expertise in DevOps, DataOps, AWS, and Python. 12+ years in data and software engineering. Deep expertise in Data Engineering, Software Engineering, Cloud Engineering, and AI (Knowledge is Mandatory). Strong understanding of DevOps, DataOps, and product management. ...

  • Data Ops Engineer

    5 days ago

    india Live Connections Full time

    Exp : 12yrs to 16yrs We are looking for a strong IC candidate who has strong expertise in DevOps, DataOps, AWS, and Python.12+ years in data and software engineering.Deep expertise in Data Engineering, Software Engineering, Cloud Engineering, and AI (Knowledge is Mandatory).Strong understanding of DevOps, DataOps, and product management.Experience with Agile...

  • Data Ops Engineer

    4 days ago

    india Live Connections Full time

    Exp : 12yrs to 16yrs We are looking for a strong IC candidate who has strong expertise in DevOps, DataOps, AWS, and Python. 12+ years in data and software engineering. Deep expertise in Data Engineering, Software Engineering, Cloud Engineering, and AI (Knowledge is Mandatory). Strong understanding of DevOps, DataOps, and product management. Experience with...

  • Data engineer

    2 weeks ago

    India GeoTech Full time

    About Us: We are an innovative technology company focused on delivering data-driven solutions that power our business operations and drive growth. We are looking for a skilled Data Engineer with deep expertise in Google Cloud solutions to join our team. This role is integral to building and maintaining our data infrastructure, ensuring scalability,...

  • Data Engineer

    1 month ago

    india Material Full time

    Role :- AWS Data Engineer Location :- Gurgaon / Bangalore Notice :- Immediate Joiners Only Skills:- AWS , Spark , Python , Glue , S3 , Redshift etc.. Experience:- 4+ Years Position Overview: We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. The ideal candidate will have extensive experience with AWS Glue, Apache...

  • Data Engineer

    1 month ago

    india Material Full time

    Role :- AWS Data Engineer Location :- Gurgaon / Bangalore Notice :- Immediate Joiners Only Skills:- AWS , Spark , Python , Glue , S3 , Redshift etc.. Experience:- 4+ Years Position Overview: We are seeking a highly skilled and motivated Data Engineer to join our dynamic team. The ideal candidate will have extensive experience with AWS Glue, Apache...

  • Senior Data Engineer

    3 weeks ago

    india NeST Digital Full time

    Design, develop, and maintain scalable and efficient data pipelines to extract, transform, and load (ETL) data from various sources into data lakes and data warehouses.Design and develop microservices toCollaborate with data scientists, analysts, and cross functional teams to design data models, database schemas and data storage solutions.Implement data...

  • Senior Data Engineer

    3 weeks ago

    India NeST Digital Full time

    Design, develop, and maintain scalable and efficient data pipelines to extract, transform, and load (ETL) data from various sources into data lakes and data warehouses. Design and develop microservices to Collaborate with data scientists, analysts, and cross functional teams to design data models, database schemas and data storage solutions. Implement...

  • Support Engineer

    4 weeks ago

    india LTIMindtree Full time

    Job Role - DataOps Engineer (Support Engineer) Experience : 3-7 Years Job Location - Hyderabad, Bangalore, Pune, Kolkata, Chennai, Noida NP - Immediate - 15 Days ROLE DESCRIPTION As a Support and Maintenance Engineer Primary Skill set: Experience in ADF/Synapse/Cosmos/SQL/ADB/PySpark Ready to work in Shift ( We have 24 X 7 Shift ) Experience with...

  • Support Engineer

    4 weeks ago

    india LTIMindtree Full time

    Job Role - DataOps Engineer (Support Engineer)Experience : 3-7 YearsJob Location - Hyderabad, Bangalore, Pune, Kolkata, Chennai, NoidaNP - Immediate - 15 DaysROLE DESCRIPTION As a Support and Maintenance EngineerPrimary Skill set: Experience in ADF/Synapse/Cosmos/SQL/ADB/PySparkReady to work in Shift ( We have 24 X 7 Shift)Experience with ICM and ability to...

  • Lead Data Engineer

    14 hours ago

    India Intuitive.Cloud Full time

    About us: Intuitive.Cloud is one of the fastest-growing (INC 5000, CRN) Cloud & SDx solution and services companies supporting enterprise customers on a global scale. Intuitive is an "Engineering Company" delivering measurable value and key business outcomes. Intuitive Superpowers: - DataOps & AI/ML - Cloud Native, AppSecOps, DevSecOps - Cloud...