Cloud data engineer

3 days ago


Delhi, India Bison Global Technology Search Full time
Cloud Data Engineer is required - 100% Remote working
IMMEDIATE JOINER REQUIRED
Cloud Data Engineer is required ASAP
With a strong background in AWS, Azure, and GCP the ideal candidate will have extensive experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, and other ETL tools like Informatica, SAP Data Intelligence, etc.
You should also have strong experience with Spark and Scala for data processing and have data extraction from SAP / ERP system experience
You will be responsible for designing, implementing, and maintaining robust data pipelines and building scalable data lakes.
Experience with various data platforms like Redshift, Snowflake, Databricks, Synapse, Snowflake and others is essential.
Key Responsibilities:
Design and Development:
Design, develop, and maintain scalable ETL pipelines using cloud-native tools (AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.).
Architect and implement data lakes and data warehouses on cloud platforms (AWS, Azure, GCP).
Develop and optimize data ingestion, transformation, and loading processes using Databricks, Snowflake, Redshift, Big Query and Azure Synapse.
Implement ETL processes using tools like Informatica, SAP Data Intelligence, and others.
Develop and optimize data processing jobs using Spark Scala.
Data Integration and Management:
Integrate various data sources, including relational databases, APIs, unstructured data, and ERP systems into the data lake.
Ensure data quality and integrity through rigorous testing and validation.
Perform data extraction from SAP or ERP systems when necessary.
Performance Optimization:
Monitor and optimize the performance of data pipelines and ETL processes.
Implement best practices for data management, including data governance, security, and compliance.
Collaboration and Communication:
Work closely with data scientists, analysts, and other stakeholders to understand data requirements and deliver solutions.
Collaborate with cross-functional teams to design and implement data solutions that meet business needs.
Documentation and Maintenance:
Document technical solutions, processes, and workflows.
Maintain and troubleshoot existing ETL pipelines and data integrations.
Essential experience must include
7+ years of experience as a Data Engineer or in a similar role.
Proven experience with cloud platforms: AWS, Azure, and GCP.
Hands-on experience with cloud-native ETL tools such as AWS DMS, AWS Glue, Kafka, Azure Data Factory, GCP Dataflow, etc.
Experience with other ETL tools like Informatica, SAP Data Intelligence, etc.
Experience in building and managing data lakes and data warehouses.
Proficiency with data platforms like Redshift, Snowflake, Big Query, Databricks, and Azure Synapse.
Experience with data extraction from SAP or ERP systems is a plus.
Strong experience with Spark and Scala for data processing.
Strong programming skills in Python, Java, or Scala.
Proficient in SQL and query optimization techniques.
Familiarity with data modeling, ETL/ELT processes, and data warehousing concepts.
Knowledge of data governance, security, and compliance best practices.
Excellent problem-solving and analytical skills.
Strong communication and collaboration skills.
Preferred Qualifications:
Experience with other data tools and technologies such as Apache Spark, or Hadoop.
Certifications in cloud platforms (AWS Certified Data Analytics – Specialty, Google Professional Data Engineer, Microsoft Certified: Azure Data Engineer Associate).
Experience with CI/CD pipelines and Dev Ops practices for data engineering
  • Cloud Data Engineer

    10 hours ago


    Delhi, Delhi, India Tata Consultancy Services Full time

    Dear applicantsWelcome to Tata Consultancy Services, a leading global IT consulting and business solutions organization.We are currently seeking an experienced Cloud Data Engineer to join our team in New Delhi.As a Cloud Data Engineer, you will play a critical role in designing, building, and maintaining large-scale data processing systems on cloud...


  • Delhi, India OSD Data Services Full time

    Data Platform EngineerLocation: RemoteType: InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...


  • Delhi, India OSD Data Services Full time

    Data Platform Engineer Location : RemoteType : InternshipAbout Us At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve...


  • Delhi, India OSD Data Services Full time

    Data Platform EngineerLocation : RemoteType : InternshipAbout UsAt OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...

  • Data Engineer

    3 weeks ago


    Delhi, India Pacific Data Integrators Full time

    Job OverviewWe are seeking a skilledData Engineerto join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on experience in MS...

  • Data Engineer

    3 weeks ago


    Delhi, India Pacific Data Integrators Full time

    Job OverviewWe are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on experience...


  • Delhi, India Restored Cloud Full time

    Machine Learning Engineer - InfrastructureJob Description:As a Machine Learning Engineer specializing in infrastructure at Restored Cloud, you will design and build the tools, frameworks, and systems that enable efficient training, deployment, and scaling of machine learning models. You will work on cutting-edge challenges in model optimization,...


  • Delhi, India OSD Data Services Full time

    Data Platform Engineer Location : RemoteType : InternshipAbout Us At OSD Data, we’re redefining how businesses leverage their data. Our mission is to empower organizations with a seamless, unified, and scalable data infrastructure that enables smarter decision-making and faster innovation. With a focus on data lakehouse technologies, we’ve built a...

  • Cloud Data Engineer

    3 weeks ago


    Delhi, Delhi, India StarTree Full time

    About StarTree:StarTree is a cloud-based software company that empowers businesses to derive actionable insights from real-time and historical data.The company was founded by the core software engineering team behind Apache Pinot, which currently powers hundreds of user-facing applications at leading companies across industries.At the heart of StarTree Cloud...


  • delhi, India Restored Cloud Full time

    Machine Learning Engineer - InfrastructureJob Description:As a Machine Learning Engineer specializing in infrastructure at Restored Cloud, you will design and build the tools, frameworks, and systems that enable efficient training, deployment, and scaling of machine learning models. You will work on cutting-edge challenges in model optimization,...

  • Data Engineer

    3 weeks ago


    Delhi, Delhi, India CYMETRIX INFOTECH PRIVATE LIMITED Full time

    Job Title: Data Engineer - Cloud ExpertAt Cymetrix Infotech Private Limited, we are seeking a highly skilled Data Engineer - Cloud Expert to join our team. This role is critical in designing and implementing scalable data pipelines on Google Cloud Platform (GCP) to drive business growth.We estimate the salary for this position to be around ₹1,200,000 per...


  • Delhi, Delhi, India Inspire Full time

    At Inspire, we are seeking a highly skilled Senior Cloud Data Engineer to join our team. As a critical member of our organization, you will play a key role in designing and building data pipelines for our Azure cloud-based data platform.The successful candidate will have strong technical, analytical, programming, and critical thinking skills, with a minimum...

  • Chief Data Architect

    1 month ago


    Delhi, Delhi, India Cloud Destinations Full time

    Senior Data Engineer at Cloud DestinationsWe are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. As a Senior Data Engineer, you will play a critical role in designing, developing, and maintaining robust data pipelines and data warehouses.Key Responsibilities:Data Engineering: - Design, develop, and maintain efficient...

  • Data Engineer

    4 weeks ago


    Delhi, Delhi, India LTIMindtree Full time

    LTIMindtree is a leading IT solutions provider, proud to offer an exciting opportunity for a skilled Data Engineer/Cloud Architect. Based in Bangalore, this role requires 5-18 years of experience with a strong background in data engineering, cloud computing, and Python programming.About the RoleThis position involves designing, developing, and maintaining...


  • Delhi, Delhi, India WaferWire Cloud Technologies Full time

    We are seeking a seasoned Senior Site Reliability Engineer to join WaferWire Cloud Technologies in Hyderabad, Telangana. This role focuses on empowering and assisting global system integrator partners, ensuring they receive the necessary support and resources for successful collaboration and integration within the Microsoft ecosystem.About WCTWaferWire Cloud...


  • Delhi, Delhi, India EverestDX Inc Full time

    Job Title: Cloud Data Engineer LeaderAbout the Company:Everest DX is a pioneering Digital Platform Services company, headquartered in Stamford. Our innovative platform includes Orchestration, Intelligent Operations with BOTS and AI-powered analytics for Enterprise IT. We aim to empower Digital Transformation for enterprises by delivering seamless customer...

  • Data Engineer

    3 weeks ago


    Delhi, Delhi, India LTIMindtree Digital Engineering and Assurance Full time

    We are seeking an experienced Data Engineer - Cloud Architect to join our team at LTIMindtree Digital Engineering and Assurance. This role will involve designing, building, and maintaining large-scale data engineering systems on cloud platforms such as GCP or AWS.The ideal candidate will have a strong background in Python, SQL, and scripting languages, with...

  • Cloud Data Engineer

    3 weeks ago


    Delhi, Delhi, India IT Company Full time

    Job Overview:We are looking for a talented Cloud Data Engineer to join our team at RS Software. In this role, you will be responsible for designing, building, deploying, testing, and administering orchestration and service architecture for CockroachDB Cloud, our database-as-a-service platform.The successful candidate will have proven experience in designing...


  • delhi, India Pacific Data Integrators Full time

    Job OverviewWe are seeking a skilled Data Engineer to join our team. In this role, you will be responsible for managing and optimizing data pipelines, ensuring the seamless movement of data across systems, and supporting data initiatives through strong technical expertise. The ideal candidate will be proficient in SQL and Python, with hands-on experience...


  • Delhi, Delhi, India Mig Staffing Full time

    Job DescriptionWe are looking for a highly skilled Data Engineer to join our Mig Staffing team. The ideal candidate will have extensive experience in designing, developing, and deploying cloud-based data platforms.You will be responsible for leading the development of our data engineering capabilities, including architecting and implementing data pipelines,...