Senior Data Engineer

2 weeks ago

bangalore, India Mitchell Martin Inc. Full time
JOB DESCRIPTION
The client is building the Data Center of Excellence team in Bangalore, India. The client is looking to hire Senior Data Engineers.
The Client Data and Commercial Technology Team is looking for Senior Data Engineers with a passion for building robust, scalable, efficient, and high-quality Data Engineering solutions to join our Engineering Centre of Excellence in Bangalore, India. This is a great opportunity to join a data-first media company and be part of our Enterprise Data Platform team that prides itself in making Clients a data-driven organization. If you enjoy designing and building innovative data engineering solutions using the latest tech stack in a fast-paced environment, this role is for you.
A SNAPSHOT OF YOUR RESPONSIBILITIES
Collaborate with and across Agile teams to design and develop data engineering solutions by rapidly delivering value to our customers
Build distributed, low latency, reliable data pipelines ensuring high availability and timely delivery of data
Design and develop highly optimized data engineering solutions for Big Data workloads to efficiently handle continuous increase in data volume and complexity
Build highly performing real-time data ingestion solutions for streaming workloads
Adhere to best practices and agreed upon design patterns across all Data Engineering solutions
Ensure the code is elegantly designed, efficiently coded, and effectively tuned for performance
Focus on data quality and consistency, implement processes and systems to monitor data quality, ensuring production data is always accurate and available for key stakeholders and business processes that depend on it.
Create design (Data Flow Diagrams, Technical Design Specs, Source to Target Mapping documents) and test (unit/integration tests) documentation
Perform data analysis required to troubleshoot data related issues and assist in the resolution of data issues.
Focus on end-to-end automation of data engineering pipelines and data validations (audit, balance controls) without any manual intervention
Focus on data security and privacy by implementing proper access controls, key management, and encryption techniques.
Take a proactive approach in learning new technologies, stay on top of tech trends, experimenting with new tools & technologies and educate other team members
Collaborate with analytics and business teams to improve data models that feed business intelligence tools, increasing data accessibility and fostering data-driven decision making across the organization
Communicate clearly and effectively to technical and non-technical leadership
WHAT YOU WILL NEED
Education: Bachelor’s degree in Computer Science, Computer Engineering, or relevant field
Work Experience:
Senior Data Engineer: 7+ years of experience in architecting, designing and building Data Engineering solutions and Data Platforms
Experience in building Data Warehouses/Data Platforms on Redshift/Snowflake
Experience working with data acquisition and transformation tools such as Fivetran and DBT
Experience building highly optimized & efficient data engineering pipelines using Python, PySpark
Experience working with distributed data processing frameworks such as Apache Hadoop, or Apache Spark or Flink
Experience working with real-time data streams processing using Apache Kafka, Kinesis or Flink
Experience working with various AWS Services (S3, EC2, EMR, Lambda, RDS, DynamoDB, Redshift, Glue Catalog)
Expertise in Advanced SQL programming and SQL Performance Tuning
Experience with version control tools such as GitHub or Bitbucket.
Expert level understanding of dimensional modeling techniques
Excellent communication, adaptability, and collaboration skills
Excellent analytical skills, strong attention to detail with emphasis on accuracy, consistency, and quality
Strong logical and problem-solving skills with critical thinking
NICE TO HAVE, BUT NOT A DEALBREAKER
Experience in designing and building applications using Container and serverless technologies
Experience working with fully automated workflow scheduling and orchestration services such as Apache Airflow
Experience working with semi-structured, unstructured data, No SQL databases
Experience with CI/CD using GitHub Actions or Jenkins
Experience designing and building APIs

  • Senior Mechanical Engineer

    1 month ago

    bangalore, India Abha Engineer Full time

    We are looking for a Senior Mechanical EngineerRoles are described below.1. Manpower Planning.2. Preparing of Project Cost.3. Schedule wise work execution.4. As Drawing & quality work execution.5. Client & Third Party Manage.6. Working Team Manage & Review.7. Reporting to Management.8. ROB & FOB Fabrication & Erection Work Knowledge.

  • Senior Mechanical Engineer

    2 weeks ago

    bangalore, India Abha Engineer Full time

    We are looking for a Senior Mechanical EngineerRoles are described below.1. Manpower Planning.2. Preparing of Project Cost.3. Schedule wise work execution.4. As Drawing & quality work execution.5. Client & Third Party Manage.6. Working Team Manage & Review.7. Reporting to Management.8. ROB & FOB Fabrication & Erection Work Knowledge.

  • Senior Data Engineer

    3 weeks ago

    bangalore, India NTT DATA Full time

    Job Description Lead Data Engineering Project Team, Expertise in Databricks, Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services,  Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server Apply from local Career site Listen to...

  • Senior Data Engineer

    3 weeks ago

    bangalore, India Giant Eagle GCC Full time

    Senior Software Engineer - Data AnalyticsGrow. Learn. Thrive. Giant Eagle is where your career can soar high. At Giant Eagle, you are so much more than an employee. You are part of the Family.About the CompanySince our founding in 1931, Giant Eagle, Inc. has evolved into one of the top 40 largest private corporations in the U.S. and one of the country’s...

  • Senior Data Engineer

    3 weeks ago

    bangalore, India Giant Eagle GCC Full time

    Senior Software Engineer - Data Analytics Grow. Learn. Thrive. Giant Eagle is where your career can soar high. At Giant Eagle, you are so much more than an employee. You are part of the Family. About the Company Since our founding in 1931, Giant Eagle, Inc. has evolved into one of the top 40 largest private corporations in the U.S. and one of the...

  • Senior Data Engineer

    1 month ago

    bangalore, India Giant Eagle GCC Full time

    Sr Data Engineer Data AnalyticsGrow. Learn. Thrive. Giant Eagle is where your career can soar high. At Giant Eagle, you are so much more than an employee. You are part of the Family.About the CompanySince our founding in 1931, Giant Eagle, Inc. has evolved into one of the top 40 largest private corporations in the U.S. and one of the country’s largest food...

  • Senior Data Engineer

    3 weeks ago

    bangalore, India Twenty20 Systems Full time

    We are seeking a talented and experienced Senior Data Engineer to join our dynamic team at Twenty20 Systems. As a Senior Data Engineer, you will play a pivotal role in designing, building, and maintaining data pipelines that empower our organization to make data-driven decisions. You will collaborate closely with cross-functional teams to gather...

  • Senior Data Engineer

    4 weeks ago

    bangalore, India Huron Full time

    The Opportunity Huron helps its clients drive growth, enhance performance and sustain leadership in the markets they serve. We help healthcare organizations build innovation capabilities and accelerate key growth initiatives, enabling organizations to own the future, instead of being disrupted by it. Together, we empower clients to create...

  • Senior Data Engineer

    4 weeks ago

    Bangalore, India Huron Full time

    The Opportunity Huron helps its clients drive growth, enhance performance and sustain leadership in the markets they serve. We help healthcare organizations build innovation capabilities and accelerate key growth initiatives, enabling organizations to own the future, instead of being disrupted by it. Together, we empower clients to create sustainable...

  • Senior Data Engineer

    2 weeks ago

    bangalore, India Huron Full time

    The Opportunity Huron helps its clients drive growth, enhance performance and sustain leadership in the markets they serve. We help healthcare organizations build innovation capabilities and accelerate key growth initiatives, enabling organizations to own the future, instead of being disrupted by it. Together, we empower clients to create...

  • Senior Data Engineer

    2 weeks ago

    Bangalore, India Huron Full time

    The Opportunity Huron helps its clients drive growth, enhance performance and sustain leadership in the markets they serve. We help healthcare organizations build innovation capabilities and accelerate key growth initiatives, enabling organizations to own the future, instead of being disrupted by it. Together, we empower clients to create sustainable...

  • Senior Data Engineer

    4 weeks ago

    bangalore, India Twenty20 Systems Full time

    We are seeking a talented and experienced Senior Data Engineer to join our dynamic team at Twenty20 Systems. As a Senior Data Engineer, you will play a pivotal role in designing, building, and maintaining data pipelines that empower our organization to make data-driven decisions. You will collaborate closely with cross-functional teams to gather...

  • Senior Data Engineer

    1 week ago

    bangalore, India Twenty20 Systems Full time

    We are seeking a talented and experienced Senior Data Engineer to join our dynamic team at Twenty20 Systems. As a Senior Data Engineer, you will play a pivotal role in designing, building, and maintaining data pipelines that empower our organization to make data-driven decisions. You will collaborate closely with cross-functional teams to gather...

  • Senior Data Engineer

    3 weeks ago

    bangalore, India New Relic, Inc. Full time

    Senior Data Engineer Senior Data Engineer Senior Data Engineer Req ID FY|S&M|#8 Location(s) Bangalore, India; Work arrangement(s) Hybrid (works from home and New Relic office throughout the week), Office (works primarily in a New Relic office) Your opportunity Do you love the transformative impact data can have on a business? Are you motivated to push for...

  • Senior Data Engineer

    2 weeks ago

    bangalore, India New Relic, Inc. Full time

    Senior Data Engineer Senior Data Engineer Senior Data Engineer Req ID FY|S&M|#8 Location(s) Bangalore, India; Work arrangement(s) Hybrid (works from home and New Relic office throughout the week), Office (works primarily in a New Relic office) Your opportunity Do you love the transformative impact data can have on a business? Are you motivated to push for...

  • Senior Data Engineer

    1 month ago

    bangalore, India Dexian India Full time

    Job Description:We are seeking a highly skilled and experienced Senior Data Engineer to join our dynamic team. The ideal candidate will have extensive experience in data engineering, ETL processes, dashboarding, and data warehousing, with a focus on building high-quality, high-volume data pipelines. If you are passionate about leveraging data to drive...

  • Senior Engineer, Data

    1 month ago

    bangalore, India News Corp Full time

    Job Description : Senior Engineer, Data One of the most innovative and high-profile teams in News Corp is looking for a seasoned data engineer to help accelerate its vision. The role will involve combining all of News Corp’s data across categories, countries and organizations into a singular view of a customer enabling engagement,...

  • Senior Engineer, Data

    2 weeks ago

    bangalore, India News Corp Full time

    Job Description : Senior Engineer, Data One of the most innovative and high-profile teams in News Corp is looking for a seasoned data engineer to help accelerate its vision. The role will involve combining all of News Corp’s data across categories, countries and organizations into a singular view of a customer enabling engagement,...

  • Senior Data Engineer

    2 months ago

    bangalore, India Squareroot Consulting Pvt Ltd Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...

  • Senior Data Engineer

    2 weeks ago

    Bangalore, Karnataka, India Squareroot Consulting Pvt Ltd Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...