Data Engineer

3 months ago

uttar pradesh, India AIonOS Full time
We are seeking talented Data Engineers to join our team and play a crucial role in designing, building, and maintaining the data infrastructure on cloud platforms for our clients. In this position, you will work closely with data architects, analysts, and cross-functional teams to develop robust and scalable data pipelines, ensuring the efficient flow of data across various systems and platforms.
About AIonOS
AIonOS, a joint venture between InterGlobe and Assago, is set to transform the AI landscape globally. AIonOS, an AI business venture, is where innovation meets human ingenuity to bring forth a future of precision and purpose in every decision businesses make. Bringing in a paradigm shift in the way enterprises run in conjunction with AI, AIonOS will transform businesses into AI-native enterprises by creating a seamless ecosystem of infrastructure, data, and AI to unlock new levels of productivity and profitability.
Responsibilities
Design and develop data ingestion pipelines to extract data from various sources, including databases, data lakes, and streaming platforms, into cloud-based data repositories.
Build and maintain ETL/ELT processes using cloud-native services and tools (e.g., Google Cloud Dataflow, Azure Data Factory, or AWS Glue) to transform and load data into data warehouses or data lakes.
Implement and optimize data processing workflows using distributed computing frameworks like Apache Spark, Apache Beam, or cloud-native services like Azure Databricks, Google Dataproc, or Amazon EMR.
Develop and maintain data storage solutions, such as data lakes (e.g., Azure Data Lake Storage, Google Cloud Storage, Amazon S3) and data warehouses (e.g., Azure Synapse Analytics, Google BigQuery, Amazon Redshift).
Collaborate with data architects, data scientists, and analysts to understand data requirements and implement efficient data models and schemas.
Ensure data quality, integrity, and security by implementing data validation, monitoring, and governance processes.
Automate and orchestrate data pipelines using cloud-native tools (e.g., Azure Data Factory, Google Cloud Composer, AWS Step Functions) for efficient and reliable data processing.
Optimize data pipelines and infrastructure for performance, scalability, and cost-effectiveness, leveraging cloud-native services and best practices.
Provide technical support and documentation for data processing solutions and infrastructure.
Qualifications
Bachelor’s or master’s degree in computer science, engineering, or a related field.
Minimum of 2 years of experience as a Data Engineer, with a strong focus on cloud technologies. (2-8 years of experience)
Proven expertise in at least one major cloud platform (Azure, GCP, or AWS) and its data services and tools. Preferably Google Cloud Platform (GCP), using services like Cloud Dataflow, Cloud Data prep, Cloud Dataproc, and Big Query.
Proficient in Python, SQL, and scripting languages like Bash or PowerShell.
Experience with data processing frameworks and libraries like Apache Spark, Apache Beam, pandas etc.
Knowledge of data warehousing concepts, data modeling techniques (e.g., star schema, dimensional modeling), and ETL/ELT processes.
Familiarity with big data technologies and frameworks like Apache Hadoop, Apache Kafka etc.
Understanding of data governance, data security, and compliance best practices.
Experience with containerization technologies like Docker and Kubernetes.
Strong problem-solving, analytical, and troubleshooting skills.
Excellent communication and collaboration skills, with the ability to work effectively in cross-functional teams.
Familiarity with agile methodologies and DevOps practices.
While expertise in Google Cloud Platform (GCP) is preferred, candidates with experience in other cloud platforms like AWS or Azure will also be considered, as the core data engineering principles and technologies are transferable across cloud providers.

  • Data Engineer

    1 day ago

    uttar pradesh, India HCLTech Full time

    Role: Data Engineer Total years of experience: 7-10 Years Location: PAN India (Any HCL office) Relevant experience for engagement: 5 Years Job Description: Relevant Skills: Maintain architecture principles, guidelines and standards Data Warehousing Programming Language: Python/Java Big Data Data Analytics GCP Services Experience in designing & implementing...

  • Data Engineer

    3 weeks ago

    uttar pradesh, India HCLTech Full time

    Role: Data EngineerTotal years of experience: 7-10 YearsLocation: PAN India (Any HCL office)Relevant experience for engagement: 5 YearsJob Description:Relevant Skills:Maintain architecture principles, guidelines and standardsData WarehousingProgramming Language: Python/JavaBig DataData AnalyticsGCP ServicesExperience in designing & implementing solution in...

  • Data Engineer

    3 weeks ago

    uttar pradesh, India InfoStride Full time

    As a Senior Data Platform Engineer , you will lead the design, development, and management across investments to platform and data pipelines. You will identify, monitor, and lead initiatives to ensure our data platform remains scalable, reliable, and efficient in light of evolving data requirements of our products and services. You will work closely with...

  • Data Engineer

    1 day ago

    uttar pradesh, India Response Informatics Full time

    JD for Data Engineer EXPERIENCE- 6-10YRS  Location – Noida  Design and maintain efficient data pipelines for seamless ETL operations.  Architect scalable data warehouses and optimize data storage systems.  Develop and deploy data models and dashboards to support business decision-making.  Collaborate with cross-functional teams to...

  • Data Engineer

    3 weeks ago

    uttar pradesh, India Varahe Analytics Private Limited Full time

    Job Description: Data EngineerLocation: NoidaAbout Varahe Analytics:Varahe Analytics is one of India’s premier integrated political consulting rms specializing in building data-driven 360-degree election campaigns. We help our clients with strategic advice and implementation, combining data-backed insights and in-depth ground intelligence into a holistic...

  • Data Engineer

    3 weeks ago

    uttar pradesh, India Response Informatics Full time

    JD for Data EngineerEXPERIENCE- 6-10YRS Location – Noida Design and maintain efficient data pipelines for seamless ETL operations. Architect scalable data warehouses and optimize data storage systems. Develop and deploy data models and dashboards to support business decision-making. Collaborate with cross-functional teams to understand data...

  • Senior Data Engineer

    7 days ago

    uttar pradesh, India Sopra Steria Full time

    Senior Data EngineerLocation: Noida/ ChennaiExperience: 4-8 yearsSkillset: Spark, Scala and HadoopRequired Skills:Strong expertise of programming languages –ScalaHands-on experience in Spark including Data frame core functions SparkSQL, Spark Streaming and with HIVE, Hadoop, Kafka, YARN.Good Experience in big data cloud platform, preferably Azure,...

  • Manager Data Engineer

    1 day ago

    uttar pradesh, India RedDoorz Full time

    Requirements: Over 4-6 years of experience in designing scalable and secure pipelines for data needs. Experience with data replication tools such as Fivetran, Stitch, Meltano or Airbyte. Strong analytical skills related to working with semi-structured datasets such as json. Experience with AWS cloud services such as EKS, EC2, S3, IAM. Experience working with...

  • Senior Data Engineer

    3 months ago

    uttar pradesh, India RedDoorz Full time

    Requirements:Over 4-6 years of experience in designing scalable and secure pipelines for data needs.Experience with data replication tools such as Fivetran, Stitch, Meltano or Airbyte.Strong analytical skills related to working with semi-structured datasets such as json.Experience with AWS cloud services such as EKS, EC2, S3, IAM.Experience working with...

  • Senior Data Engineer

    3 weeks ago

    uttar pradesh, India GlobalXperts Full time

    Job Title : Data EngineerJob Type : Full-timeExperience Level : Mid to SeniorShift : 24*7 ShiftLocation : 902, Tower B, Urbtech Trade Center, Sector 132, Noida, Uttar PradeshAbout GlobalXperts:GlobalXperts is a worldwide solutions provider dedicated to supporting their customers with all phases of the solution lifecycle for advanced technologies.  From...

  • Big data Engineer

    3 weeks ago

    uttar pradesh, India Webologix Ltd INC Full time

    Job Title: Big Data EngineerLocation: NoidaEmployment Type: PermanentJob Description:We are looking for a skilled Big Data Engineer with a strong background in Python and PySpark to join our team in Noida. The ideal candidate should have a passion for building scalable data solutions and a deep understanding of Big Data technologies.Key...

  • Senior Data Engineer

    1 day ago

    uttar pradesh, India EXL Full time

    Job Title : Sr. Data Engineer (6-7 Year of Experience) Location: Noida Employment Type: Full Time Business Unit: Analytics About EXL EXL (NASDAQ:EXLS) is a leading operations management and analytics company that helps businesses enhance growth and profitability in the face of relentless competition and continuous disruption. Using our proprietary,...

  • Celonis Data Engineer

    1 day ago

    uttar pradesh, India Tech Mahindra Full time

    Job Role: Senior Data Engineer Experience: 2+ years Location" PAN India Must Have: Celonis Process Mining / UI Path Process Mining/ Signavio Process Mining/Minit Process mining or any other process mining tool Roles And Responsibilities: Hands-on experience on Celonis Process Mining/UI Path Process Mining/ Signavio Process Mining/Minit Process mining...

  • Senior Data Engineer

    4 months ago

    uttar pradesh, India Tech Mahindra Full time

    Job Role: Senior Data EngineerExperience: 6+ yearsLocation" PAN IndiaMust Have: Celonis Process Mining / UI Path Process Mining/ Signavio Process Mining/Minit Process mining or any other process mining toolRoles And Responsibilities:Hands-on experience on Celonis Process Mining/UI Path Process Mining/ Signavio Process Mining/Minit Process mining or any...

  • Digital Marketing Intern

    5 months ago

    Indore, Madhya Pradesh, India Engineer Sahab Full time

    **Job Description - Engineer Sahab** **Job title**:Digital Marketing Intern **Experience **:Fresher **Location**:Indore **Terms**:Full time **About us**:Engineer Sahab is a leading and highly innovative IT company that caters to offshore Web and Mobile App Development. Our committed teams have a unique blend of functional and operational knowledge,...

  • Data Ops Engineer

    1 day ago

    uttar pradesh, India Innovaccer Full time

    About the Role We are looking for a Data Ops Engineer-II to help our customers explore their healthcare data, understand how to improve the health of the population and bring down the cost of healthcare. A Day in the Life Create world class customer facing documentation which would delight and excite customers Remove ambiguity in understanding things by...

  • Data Ops Engineer

    3 weeks ago

    uttar pradesh, India Innovaccer Full time

    About the RoleWe are looking for a Data Ops Engineer-II to help our customers explore their healthcare data, understand how to improve the health of the population and bring down the cost of healthcare.A Day in the LifeCreate world class customer facing documentation which would delight and excite customersRemove ambiguity in understanding things by...

  • Data Architect

    1 day ago

    uttar pradesh, India HCLTech Full time

    Role: GCP Data Architect Total years of experience: 10+ Years Location: Noida, Bangalore, Chennai, Pune, Hyderabad Relevant experience for engagement: 7 Years Relevant Skills : Strategic Planning and Direction Maintain architecture principles, guidelines and standards Project & Program Management Data Warehousing Big Data Data Analytics & Data Science for...

  • Data Cabl

    3 months ago

    Uttar Pradesh, India FPS Full time

    First People Solutions require Data Cabling Engineers for an immediate start on a major project in Dundee Duration - 12 weeks Rate - £22ph If interested please give me a call on the below for more information: Camille - 07514315439

  • Data Architect

    4 months ago

    uttar pradesh, India HCLTech Full time

    Role: GCP Data ArchitectTotal years of experience: 10+ YearsLocation: Noida, Bangalore, Chennai, Pune, HyderabadRelevant experience for engagement: 10 YearsRelevant Skills :Strategic Planning and DirectionMaintain architecture principles, guidelines and standardsProject & Program ManagementData WarehousingBig DataData Analytics & Data Science for...