Senior Data Engineer

1 week ago

Bengaluru, Karnataka, India DAT Freight & Analytics Full time

About DAT

DAT is an award-winning employer of choice and a next-generation SaaS technology company that has been at the leading edge of innovation in transportation supply chain logistics for 45 years. We continue to transform the industry year over year, by deploying a suite of software solutions to millions of customers every day - customers who depend on DAT for the most relevant data and most accurate insights to help them make smarter business decisions and run their companies more profitably. We operate the largest marketplace of its kind in North America, with 400 million freights posted in 2022, and a database of $150 billion of annual global shipment market transaction data. Our headquarters are in Denver, CO, with additional offices in Missouri, Oregon, and Bangalore, India. For additional information, see.

The Opportunity

AT DAT, Our leaders optimistically share future possibilities to inspire and motivate others toward their full potential. We expect our employees to find ways to embrace positive change, be curious and challenge the status quo, and provide solutions to unmet problems. Joining DAT means joining a culture focused on fostering development, building genuine connections, recognizing each other's strengths and sharing in successes.

As a Senior Data Engineer, you will be responsible for developing data engineering patterns and practices within the organization and in the team. You will support us in designing, building, and maintaining our data infrastructure, with a special focus on reusability, availability, and scalability in AWS. You will have the opportunity to work on challenging platform and data-related problems and to have a measurable impact on the organization. Designing and building the evolution of data as a product including coordination across multiple systems, data privacy, data quality, and discoverability while introducing new ideas, patterns, and technologies in support of our customers and internal stakeholders.

What You'll Do

Supporting us with evolving our data platform architectureKnowledgeable of implementing known patterns and their impact to a microservices architecture-based data platform, such as Event Driven, CQRS, event sourcing, Saga pattern, etcDW modeling (kimball, inmon, data vault and concepts such as data mesh)In depth knowledge of AWSProviding solutions for complex business problems, enabling insights that can empower better decision-makingTaking an active role in fostering a culture of learning and excellence

The Skills and Experience You'll Bring

Bachelor's degree in Computer Science, Computer Engineering or related technical discipline5+ years of relevant engineering experienceAbility to lead, teach, mentor and execute at the highest levelYou are a strong data engineer having worked with Kafka, DBT, Airflow, cloud based services (AWS S3, EMR, Glue) and with containers (Docker, Kubernetes, ECS, EKS)You bring hands-on experience in creating and managing CI/CD pipelines, IaC (Terraform), Snowflake and building automated testingStrong python and SQL skillsLeverage data to prioritize your work and to influence othersPassionate about implementing change and improvements when seeing an opportunityExperience building and operating large scale, distributed systemsKnowledge of professional software engineering practices and best practices for the full software development and technology management life cycle, including coding standards, code reviews, source control management, build processes, testing, monitoring, alerting and operations; Agile a plus.Excellent verbal and written communication skillsAbility to drive continuous learning and improvement for yourself, and others in the organization. Fostering a community of continuous growth in our knowledge and skills

DAT embraces the value of a diverse workforce, and believes it is a core strength of our company that we encourage those values in every DAT employee, at every level of our organization, regardless of tenure or rank. We provide equal employment opportunities (EEO) to all employees and applicants without regard to race, color, religion, gender, sexual orientation, gender identity or expression, national origin, age, disability, genetic information, marital status, amnesty, or status as a covered veteran in accordance with applicable federal, state, and local laws.

Equal Opportunity Employer/Protected Veterans/Individuals with Disabilities

The contractor will not discharge or in any other manner discriminate against employees or applicants because they have inquired about, discussed, or disclosed their own pay or the pay of another employee or applicant. However, employees who have access to the compensation information of other employees or applicants as a part of their essential job functions cannot disclose the pay of other employees or applicants to individuals who do not otherwise have access to compensation information, unless the disclosure is (a) in response to a formal complaint or charge, (b) in furtherance of an investigation, proceeding, hearing, or action, including an investigation conducted by the employer, or (c) consistent with the contractor's legal duty to furnish information. 41 CFR c)

#LI-SC1

  • Senior Mechanical Engineer

    1 week ago

    Bengaluru, Karnataka, India Abha Engineer Full time

    We are looking for a Senior Mechanical EngineerRoles are described below.Manpower Planning.Preparing of Project Cost.Schedule wise work execution.As Drawing & quality work execution.Client & Third Party Manage.Working Team Manage & Review.Reporting to Management.ROB & FOB Fabrication & Erection Work Knowledge.

  • Senior Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Lead Data Engineering Project Team, Expertise in Databricks, Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services, Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server Apply from local Career site Listen to the story...

  • Senior Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job Description Lead Data Engineering Project Team, Expertise in Databricks,Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services, Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server Apply from local Career site Listen to the story of...

  • Senior Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Services Full time

    Lead Data Engineering Project Team, Expertise in Databricks, Expertise in Data Management & Data Governance,Expertise in Azure Cloud and its services, Experienced in Data Modelling and Data Pipelines,Experienced in Healthcare projects, Experience implementing FHIR Data model and FHIR Server

  • Senior Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Giant Eagle GCC Full time

    Senior Software Engineer - Data AnalyticsGrow. Learn. Thrive. Giant Eagle is where your career can soar high. At Giant Eagle, you are so much more than an employee. You are part of the Family.About the CompanySince our founding in 1931, Giant Eagle, Inc. has evolved into one of the top 40 largest private corporations in the U.S. and one of the country's...

  • Senior Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Giant Eagle GCC Full time

    Sr Data Engineer Data AnalyticsGrow. Learn. Thrive. Giant Eagle is where your career can soar high. At Giant Eagle, you are so much more than an employee. You are part of the Family.About the CompanySince our founding in 1931, Giant Eagle, Inc. has evolved into one of the top 40 largest private corporations in the U.S. and one of the country's largest food...

  • Data Engineer

    1 week ago

    Bengaluru, Karnataka, India NTT DATA Full time

    Job DescriptionData Engineer - Snowflake, Oracle/MySQL, NoSQL, Python8 to 13 years of experience in Data engineeringExtensive experience in different database platforms both RDBMS (Oracle, MySQL) and NoSQL (MongoDB)Hands-on experience in SnowflakeProficient in Data Pipeline OrchestrationProficient in any one of the programing languages (python or...

  • Senior Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Huron Full time

    The OpportunityHuron helps its clients drive growth, enhance performance and sustain leadership in the markets they serve. We help healthcare organizations build innovation capabilities and accelerate key growth initiatives, enabling organizations to own the future, instead of being disrupted by it. Together, we empower clients to create sustainable growth,...

  • Senior Data Engineer/ Lead Data Engineer

    2 days ago

    Bengaluru, Karnataka, India Upstox Full time

    Apply for Upstox Senior Data Engineer/ Lead Data Engineer, Career Progress Consultants in Bengaluru/ Bangalore for Year of Experience on

  • Senior Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Mitchell Martin Inc. Full time

    JOB DESCRIPTIONThe client is building the Data Center of Excellence team in Bangalore, India. The client is looking to hire Senior Data Engineers.The Client Data and Commercial Technology Team is looking for Senior Data Engineers with a passion for building robust, scalable, efficient, and high-quality Data Engineering solutions to join our Engineering...

  • Senior Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Lorven Technologies Full time

    JOB TITLE: Senior Data Engineer - Cloud Analytics SpecialistJoin our team as a Senior Data Engineer specializing in Cloud Analytics! You will have a pivotal role in designing, constructing, and managing scalable data pipelines and analytics solutions on various cloud platforms. Utilize your expertise in data engineering, cloud technologies, and analytics...

  • Senior Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Twenty20 Systems Full time

    We are seeking a talented and experienced Senior Data Engineer to join our dynamic team at Twenty20 Systems. As a Senior Data Engineer, you will play a pivotal role in designing, building, and maintaining data pipelines that empower our organization to make data-driven decisions. You will collaborate closely with cross-functional teams to gather...

  • Senior Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Twenty20 Systems Full time

    We are seeking a talented and experienced Senior Data Engineer to join our dynamic team at Twenty20 Systems. As a Senior Data Engineer, you will play a pivotal role in designing, building, and maintaining data pipelines that empower our organization to make data-driven decisions. You will collaborate closely with cross-functional teams to gather...

  • Senior Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Squareroot Consulting Pvt Ltd Full time

    We are seeking a highly skilled and experienced Senior Data Engineer to join our team.Location : Bangalore (Work from Office all 5 days)Experience : 6+ YearsRole : Senior Data EngineerThe ideal candidate will have a strong background in big data technologies and extensive hands-on experience with Cloudera, Spark, Hive, HDFS, Flink, Data Lake, and...

  • Senior Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Commonwealth Bank Full time

    Organisation: At CommBank, we are always aware of the impact we have on people's financial wellbeing. Our goal is to support individuals and businesses in moving forward towards achieving their dreams and aspirations. No matter where you are in our team, your creativity, skills, ideas, and enthusiasm all contribute to the meaningful work we do. Together, we...

  • Senior Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Philips Full time

    Job Title: Senior Data EngineerJob Description:Overall Job SummaryThe Senior Data Engineer specializes in designing and developing cutting-edge data pipelines and Analytical Solutions. In this role, you will play a key part in the company's transition from On-Premises to Cloud. Collaborate with Data Scientists, Business Analysts, and Clinical teams; provide...

  • Senior Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Infometry Full time

    Senior Data Engineer Company: Infometry IncLocation: RemoteRole : Senior data EngineerShift : 2PM-11PMEXP:4-7 yearsNP: ImmediateJob Description :We are seeking a skilled Data Engineer to join our dynamic team. As a Data Engineer, you will be responsible for designing, developing, and maintaining data pipelines and infrastructure to support our data...

  • Senior Data Engineer

    1 week ago

    Bengaluru, Karnataka, India TalentPulse Consultant Full time

    Job Description:We are looking for a talented Senior Data Engineer to join our team in Bangalore. As a Senior Data Engineer, you will be responsible for designing, building, and maintaining scalable data pipelines and infrastructure to support our data-driven initiatives. This position offers a hybrid work model, allowing a combination of remote and onsite...

  • Senior Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Pplability INC Full time

    Job Title: Senior Data Engineer-Data Modeling Location: Bengaluru, Chennai, Hyderabad.Curious about the role? What your typical day would look like? As a Senior Data Engineer, you will work to solve some of the organizational data management problems that would enable them as a data-driven organization; Seamlessly switch between roles of an Individual...

  • Senior Data Engineer

    1 week ago

    Bengaluru, Karnataka, India Mitchell Martin Inc. Full time

    JOB DESCRIPTION The client is building the Data Center of Excellence team in Bangalore, India. The client is looking to hire Senior Data Engineers. The Client Data and Commercial Technology Team is looking for Senior Data Engineers with a passion for building robust, scalable, efficient, and high-quality Data Engineering solutions to join our Engineering...