Data Engineer

1 month ago

BangaloreChandigarh, India Aliqan Services Private Limited Full time

Job Description :
  • Designing a robust, secure, and optimized AWS architecture to implement large-scale enterprise data solutions and applications
  • The primary focus is on Glue, S3, Redshift, Lambda, Spark, AWS Athena, AWS Arora, DMS, Redshift Spectrum, Airflow, AWS Transfer Family, Hudi, Schema Conversion Tool
  • Experience to build CICD pipeline on AWS (Code commit, Code Build, Code Deploy, Code Pipeline)
  • Experience in Python, PySpark, Spark SQL
  • Experience working on migrating SSIS packages to data pipelines in the AWS platform
  • Implement process and quality improvements through task automation.
  • Institute infrastructure as code, security automation, and automation or routine maintenance tasks
  • Provide technical solutions and consulting to the application teams for the migration approach
  • Develop documentation throughout the software development life cycle (SDLC) & Agile mythology
  • Create Crawlers to populate data catalog tables by connecting to diverse data sources, manage data in a centralized repository, and visually create, run, and monitor data pipelines to load data
  • Works closely with Power BI developers to develop designs, manage metadata, manage data quality, and build standard calculations and reporting solutions
  • Have experience in supporting large Data warehouses and Service Management Process
  • Good communication and problem-solving :

    1. Responsible for designing and implementing scalable and high-performance Data Cloud solutions. You will partner with the data engineering team, Platform team, and Application teams to deliver cloud based Analytical Solutions.

    2. Work with the Customer to finalize the detailed requirement spec.

    3. Strong problem-solving skills are essential. Ability to troubleshoot issues and provide timely resolution

    4. Transform requirements into stipulations and identify production and non-production application issues

    5. Build and support data and user-level security across DW data architecture and Power BI datasets

    6. Researches, recommends and leverages new features of AWS platform capabilities to deliver business insights and analytics

    (ref:hirist.tech)

  • Aptus Data Labs

    4 weeks ago

    Bangalore, Karnataka, India Aptus Data Labs Full time

    Aptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp- 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...

  • Aptus Data Labs

    2 weeks ago

    Bangalore, India Aptus Data Labs Full time

    Aptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp - 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...

  • Aptus Data Labs

    1 month ago

    bangalore, India Aptus Data Labs Full time

    Aptus Data Labs is an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting services.Role - Machine Learning EngineerExp - 3-5 YrsLocation - RemoteSkill - AWS Sagemaker , ML Pipeline, Machine Learning, AI, Python, NLP, , CI/CD , AWS Services - Lambda, Step functions and other AWS ServicesThe ideal...

  • Data Engineer

    1 week ago

    Chandigarh, India emerson Full time

    Job SummaryIf you are an experiencedData Engineeringprofessional passionate about building data solutions and looking for an opportunity to grow, Emerson has an exciting opportunity for you. To be successful in this role, you will need to apply logical data modelling, development, and engineering skills using the latest technology stack we have in place...

  • Data Engineer

    1 week ago

    bangalore, India ANZ Full time

    About the role Data Engineer – Role Type – FTE Job Grade: Group 4.3 At ANZ our purpose is to shape a world where people and communities thrive and to achieve this, we need a talented Data Engineer to join our Australia Commercial tribe. The Australia Data tribe sits within our Australia Commercial division and our mission is...

  • Data Engineer

    1 week ago

    Chandigarh, India emerson Full time

    Job Summary If you are an experienced Data Engineering professional passionate about building data solutions and looking for an opportunity to grow, Emerson has an exciting opportunity for you. To be successful in this role, you will need to apply logical data modelling, development, and engineering skills using the latest technology stack we have in...

  • Data Engineer

    1 week ago

    chandigarh, India emerson Full time

    Job Summary If you are an experienced Data Engineering professional passionate about building data solutions and looking for an opportunity to grow, Emerson has an exciting opportunity for you. To be successful in this role, you will need to apply logical data modelling, development, and engineering skills using the latest technology stack we have...

  • Data Engineer, IN Data Engineering

    1 month ago

    bangalore, India ADCI - Karnataka Full time

    IN Data Engineering & Analytics(IDEA) Team is looking to hire a rock star Data Engineer to build and manage the largest petabyte-scale data infrastructure in India for Amazon India businesses.IN Data Engineering & Analytics (IDEA) team is the central Data engineering and Analytics team for all A.in businesses. The team's charter includes 1) Providing Unified...

  • Data Engineer

    5 days ago

    bangalore, India SMARTBORN SOFTWARE CONSULTING PVT.LTD. Full time

    Role Description This is a full-time hybrid role as a Data Engineer at SMARTBORN SOFTWARE CONSULTING PVT.LTD. The Data Engineer will be responsible for day-to-day tasks related to data engineering, including data modeling, Extract Transform Load (ETL) development, data warehousing, and data analytics. The role is based in Bengaluru, with flexibility for...

  • Data Engineer

    1 week ago

    bangalore, India Australia and New Zealand Banking Group Limited (ANZ) Full time

    Data Engineer Data Engineer Req ID: Department: Commercial Data & Analytics Division: Australia Commercial Location: Bengaluru About the role Data Engineer – Role Type – FTE Job Grade: Group 4.3 At ANZ our purpose is to shape a world where people and communities thrive and to achieve this, we need a talented Data Engineer to join...

  • Data Engineer

    1 month ago

    bangalore, India Analog Devices Full time

    Gather business and functional requirements and translate into robust scalable, solutions aligned to the Data Architecture guidelines Hands on development work on all aspects of data analysis, data provisioning, Data modeling, performance tuning and optimization Design, implement and operate large scale, high volume, high performance data structures for...

  • Data Engineer

    2 days ago

    bangalore, India Joveo Full time

    Role: Data Engineer Location: Hybrid (Bangalore/Hyderabad) About Joveo Joveo was founded in 2017 by a group of visionary entrepreneurs and enthusiastic problem solvers who foresaw the need for greater transparency and predictability in recruitment marketing. The focus was on building a cutting-edge technology platform that uses data and...

  • Data Engineer

    2 weeks ago

    bangalore, India Aryng Full time

    Welcome! You made it to the job description page! Aryng is looking for a Senior Data Engineer with experience in developing enterprise-class distributed data engineering solutions on the cloud. We are seeking an entrepreneurial and technology-proficient Data Engineer who is an expert in theimplementation of a large-scale, highly efficient data platform,...

  • Data Engineer

    1 month ago

    bangalore, India Yara Full time

    Responsibilities Participate in designing and building data pipelines to collect, manage and store data across different solutions and tools where the data resides for the YAA teams. Monitor, manage and maintain data pipelines as part of the day-to-day data operations. Build data mart tables for various use cases by working with the different data...

  • Data Engineer

    4 weeks ago

    Bangalore, Karnataka, India Magna Hire Full time

    Responsibilities :Support the data engineering team in implementing analytics solutions, ensuring adherence to project timelines and quality standards.Participate in at least one full implementation lifecycle of dbt (data build tool), contributing to design, development, and deployment phases.Assist senior team members in optimizing dbt models and...

  • Data Engineer

    1 month ago

    Bangalore, India Magna Hire Full time

    Responsibilities : Support the data engineering team in implementing analytics solutions, ensuring adherence to project timelines and quality standards. Participate in at least one full implementation lifecycle of dbt (data build tool), contributing to design, development, and deployment phases. Assist senior team members in optimizing dbt models and...

  • Data Engineer

    2 days ago

    bangalore, India RaaGaa Value Add Technologies. Full time

    Key Responsibilities: 1.Design, develop, and maintain scalable data pipelines and ETL processes to extract, transform, and load large volumes of structured and unstructured data from diverse sources in Batch and Real-time processing. 2.Collaborate with cross-functional teams, including data scientists, software engineers, and business stakeholders, to...

  • Aptus Data Labs

    1 month ago

    bangalore, India Aptus Data Labs Full time

    Aptus Data Labs is a Bangalore based an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting servicesRole : Fresher- Frontend : BangaloreJob Description : Qualifications : - Bachelor's degree in computer science, MIS, or related discipline required (2023/2024 passed out) - knowledge in developing modular...

  • Aptus Data Labs

    4 weeks ago

    Bangalore, Karnataka, India Aptus Data Labs Full time

    Aptus Data Labs is a Bangalore based an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting servicesRole : Fresher- Frontend : BangaloreJob Description :Qualifications :- Bachelor's degree in computer science, MIS, or related discipline required (2023/2024 passed out)- knowledge in developing modular...

  • Aptus Data Labs

    2 weeks ago

    Bangalore, India Aptus Data Labs Full time

    Aptus Data Labs is a Bangalore based an innovative Data Engineering and Advanced Analytics company offering analytical solutions and consulting servicesRole : Fresher- Frontend : BangaloreJob Description : Qualifications : - Bachelor's degree in computer science, MIS, or related discipline required (2023/2024 passed out) - knowledge in developing...