Data Engineer 2

2 months ago

bangalore, India BigShyft Full time
RoleOverview: As a Data Engineer 2you will be responsible for designing implementing and maintainingscalable data pipelines and systems. You will collaborate closelywith crossfunctional teams to understand data requirements developrobust solutions and ensure the reliability and performance of ourdata infrastructure. This role offers an exciting opportunity towork with cuttingedge technologies in a dynamic and fastpacedenvironment.
KeyResponsibilities:
  • Designdevelop and optimize data pipelines to collect process and storelarge volumes of structured and unstructureddata.
  • Implement ETL processes to transform rawdata into actionable insights ensuring data quality and integritythroughout the process.
  • Manage and maintaindata warehouse systems including AWS Redshift to support analyticaland reporting needs.
  • Utilize Apache Airflow forworkflow orchestration and scheduling of datapipelines.
  • Work with streaming datatechnologies such as Apache Kafka to handle realtime data ingestionand processing.
  • Collaborate with datascientists and analysts to understand their requirements andimplement solutions for advanced analytics and machinelearning.
  • Monitor system performancetroubleshoot issues and implement optimizations to ensurescalability reliability and efficiency.
  • Stayupdated on industry trends and best practices in data engineeringand recommend new technologies and methodologies to enhance ourdatainfrastructure.

RequiredSkills andQualifications:
  • Bachelorsdegree in Computer Science Engineering or relatedfield.
  • 36 years of experience in dataengineering roles with a focus on building and maintaining datapipelines and systems.
  • Proficiency inprogramming languages such as Python and Scala for data processingand automation.
  • Strong experience with cloudplatforms particularly AWS including services like Redshift EMRAthena and S3.
  • Handson experience with workfloworchestration tools such as ApacheAirflow.
  • Familiarity with streaming datatechnologies like Apache Kafka for realtime dataprocessing.
  • Solid understanding of databaseconcepts SQL and data modelingtechniques.
  • Experience working in Agiledevelopment environments and using version control systems likeGit.
  • Excellent problemsolving skills and theability to work effectively in a collaborative teamenvironment.
  • Strong communication andinterpersonal skills with the ability to effectively conveytechnical concepts to nontechnicalstakeholders.

dataengineering,aws,amazon redshift,etl,spark,kafka,athena,datamodeling,data warehouse,data analysis,airflow,python,sql,glue,awslambda,cdc,apache kafka

  • Data Engineer 2

    2 months ago

    bangalore, India JLL Full time

    Data Engineer 2 JLL Technologies COE About JLL and JLL Technologies JLL is a leading professional services firm that specializes in real estate and investment management. Our vision is to reimagine the world of real estate, creating rewarding opportunities and amazing spaces where people can achieve their ambitions. In doing so, we will build...

  • Senior Mechanical Engineer

    3 weeks ago

    bangalore, India Abha Engineer Full time

    We are looking for a Senior Mechanical EngineerRoles are described below.1. Manpower Planning.2. Preparing of Project Cost.3. Schedule wise work execution.4. As Drawing & quality work execution.5. Client & Third Party Manage.6. Working Team Manage & Review.7. Reporting to Management.8. ROB & FOB Fabrication & Erection Work Knowledge.

  • Senior Mechanical Engineer

    2 months ago

    bangalore, India Abha Engineer Full time

    We are looking for a Senior Mechanical EngineerRoles are described below.1. Manpower Planning.2. Preparing of Project Cost.3. Schedule wise work execution.4. As Drawing & quality work execution.5. Client & Third Party Manage.6. Working Team Manage & Review.7. Reporting to Management.8. ROB & FOB Fabrication & Erection Work Knowledge.

  • Data Engineer 2

    3 weeks ago

    bangalore, India Amadeus Full time

    Job Title Data Engineer 2Key responsibilities •Design, implement, deploy, and maintain data marts, ETL (extract, transform, load) processes and systems. A.k.a. as our assets. •Ensure the reliability, scalability, and performance of our data assets. •Design and maintain quality indicators as well as the corresponding monitoring and alerting means. ...

  • Data Engineer 2

    2 months ago

    bangalore, India Amadeus Full time

    Job Title Data Engineer 2Key responsibilities •Design, implement, deploy, and maintain data marts, ETL (extract, transform, load) processes and systems. A.k.a. as our assets. •Ensure the reliability, scalability, and performance of our data assets. •Design and maintain quality indicators as well as the corresponding monitoring and alerting means. ...

  • Data Engineer 2

    1 month ago

    bangalore, India Microsoft Full time

    Overview Data Engineer - Office Platform Microsoft IDC - Bengaluru, India Profession: Software Engineering Discipline: Data Engineering Microsoft is a global leader in software, services, devices and solutions that empower every person and every organization on the planet to achieve more. Our mission is to enable people and businesses...

  • Data Engineer 2

    3 weeks ago

    bangalore, India Microsoft Full time

    Overview Data Engineer - Office Platform Microsoft IDC - Bengaluru, India Profession: Software Engineering Discipline: Data Engineering Microsoft is a global leader in software, services, devices and solutions that empower every person and every organization on the planet to achieve more. Our mission is to enable people and businesses...

  • Senior Data Engineer

    4 weeks ago

    bangalore, India NTT DATA Full time

    Job Description Lead Data Engineering Project Team, Expertise in Databricks, Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services,  Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server Apply from local Career site Listen to...

  • Required. Azure Data Engineering with Databricks Azure Data Engineer with Databricks

    4 weeks ago

    bangalore, India NTT DATA Full time

    Job Description Azure Data Engineer Requirements 4+ years’ overall experience in data domain (data analysis, database developer) Minimum 3 years’ experience as a cloud-based Data Engineer Minimum 3 years’ experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years’...

  • Data Engineer

    1 month ago

    bangalore, India NTT DATA Full time

    Job Description Data Engineer - Snowflake, Oracle/MySQL, NoSQL, Python • 8 to 13 years of experience in Data engineering• Extensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB)• Hands-on experience in Snowflake• Proficient in Data Pipeline Orchestration• Proficient in any one of the programing...

  • Data Engineer

    4 weeks ago

    bangalore, India NTT DATA Full time

    Job Description Data Engineer - Snowflake, Oracle/MySQL, NoSQL, Python • 8 to 13 years of experience in Data engineering• Extensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB)• Hands-on experience in Snowflake• Proficient in Data Pipeline Orchestration• Proficient in any one of the programing...

  • Data Engineer

    4 weeks ago

    bangalore, India NTT DATA Full time

    Job Description Data Engineer - Snowflake, Oracle/MySQL, NoSQL, Python • 8 to 13 years of experience in Data engineering• Extensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB)• Hands-on experience in Snowflake• Proficient in Data Pipeline Orchestration• Proficient in any one of the programing...

  • Sr data engineer

    1 day ago

    bangalore, India NTT DATA Services Full time

    Req ID:  286326  NTT DATA Services strives to hire exceptional, innovative and passionate individuals who want to grow with us. If you want to be part of an inclusive, adaptable, and forward-thinking organization, apply now. We are currently seeking a Sr data engineer to join our team in Bangalore, Karnātaka (IN-KA), India (IN). Senior data engineer   ...

  • Required. Azure Data Engineering with Databricks Azure Data Engineer with Databricks

    3 weeks ago

    Bangalore, India NTT DATA Services Full time

    Azure Data Engineer Requirements 4+ years’ overall experience in data domain (data analysis, database developer) Minimum 3 years’ experience as a cloud-based Data Engineer Minimum 3 years’ experience and strong knowledge of Azure Data Services such as Azure Data Lake Storage, Blob Storage, Azure Data Factory, Minimum 3 years’ experience...

  • Data Engineer

    4 weeks ago

    Bangalore, India NTT DATA Services Full time

    Data Engineer - Snowflake, Oracle/MySQL, NoSQL, Python   • 8 to 13 years of experience in Data engineering • Extensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB) • Hands-on experience in Snowflake • Proficient in Data Pipeline Orchestration • Proficient in any one of the programing...

  • Data Engineer

    1 month ago

    bangalore, India NTT DATA Services Full time

    Data Engineer - Snowflake, Oracle/MySQL, NoSQL, Python   • 8 to 13 years of experience in Data engineering• Extensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB)• Hands-on experience in Snowflake• Proficient in Data Pipeline Orchestration• Proficient in any one of the programing languages (python or...

  • Data Engineer-2

    1 month ago

    bangalore, India E901 DWS India Private Limited, Bangalore Branch Full time

    Description Role is an Data Engineer to manage the databases/data warehouses/ data marts within the Asset Management Fund Accounting/Investment Business. Has good understanding of Bafin/FCA/BundesBank regulatory reporting framework and reporting experiences. Can handle the day-to-day BAU of several Datawarehouse and Database Applications as part...

  • Data Analyst 2

    3 weeks ago

    bangalore, India Oracle Full time

    Building off our Cloud momentum, Oracle has formed a new organization - Oracle Health Applications & Infrastructure. This team will focus on product development and product strategy for Oracle Health, while building out a complete platform supporting modernized, automated healthcare. This is a net new line of business, constructed with an entrepreneurial...

  • Data Analyst 2

    2 months ago

    bangalore, India Oracle Full time

    Building off our Cloud momentum, Oracle has formed a new organization - Oracle Health Applications & Infrastructure. This team will focus on product development and product strategy for Oracle Health, while building out a complete platform supporting modernized, automated healthcare. This is a net new line of business, constructed with an entrepreneurial...

  • Data Architect

    4 weeks ago

    bangalore, India NTT DATA Full time

    Job Description : Data Modeler (8 to 12 years of experience)Summary:Do you thrive in the nexus of business needs and complex data landscapes? Do you possessthe vision to translate strategic goals into elegant and scalable data architectures? If so, thenstep into the role of Data Modeler and shape the future of data at Salesforce!We are seeking a Data...