Data Engineer
5 hours ago
Bangalore, Karnataka, India
Bristlecone
Full-time
Free with email or Google
Save this job and keep your search organized
Create a free account to save jobs, create alerts and return to this listing from your dashboard.
Free with email or Google
By continuing, you agree to our Terms & Privacy Policy.
Develop API-driven systems to govern, manage, and monitor large-scale batch Big Data applications.
Build scalable backend services and data engineering solutions that support data processing and operational workflows.
Develop and maintain data transformation processes using Spark, SQL, Hive, Python, Scala, and related technologies.
Work with AWS cloud services such as S3, EC2, EMR, Lambda, DynamoDB, and API Gateway to build cloud-native data and backend solutions.
Build and enhance workflow orchestration using Apache Airflow, including advanced DAG design, dependency management, scheduling, monitoring, and failure handling.
Define technical scope, objectives, and implementation approaches by participating in requirements gathering, technical research, and process definition.
Participate in architecture reviews, code reviews, performance tuning, and operational readiness activities.
Contribute to test planning and validation for application integrations, functional areas, and project deliverables.
Partner with product owners, data engineers, backend engineers, QA, DevOps, and other cross-functional teams to deliver high-quality solutions in an Agile/Scrum environment.
Troubleshoot production issues, improve system reliability, and drive automation across data and backend workflows.
Responsibilities
5+ years of hands-on experience developing enterprise-scale applications, data platforms, or distributed systems.
5+ years of experience developing, and operating Big Data platforms and cloud-based infrastructure services, preferably using AWS EMR and the Hadoop ecosystem.
Hands-on experience with AWS, Spark, Python and/or Scala, Airflow, SQL, Hive, and related data processing technologies.
Proficiency in either Python or Scala, with the ability to build production-grade data pipelines and backend services.
Experience with AWS cloud services, including S3, EC2, EMR, Lambda, DynamoDB, and API Gateway.
Strong experience with Apache Airflow orchestration, including complex workflows, scheduling, dependency handling, monitoring, and operational support.
Strong understanding of data engineering concepts, including data pipelines, data transformation, batch processing, real-time processing, data quality, and performance optimization.
Excellent analytical and problem-solving skills.
Strong communication and presentation skills, with the ability to explain technical concepts clearly to both technical and non-technical audiences.
Experience with version control and CI/CD tools, including Git and Jenkins, for source code management, build automation, testing, and deployment workflows.
Ability to work effectively in cross-functional Agile/Scrum teams.
Qualifications
Experience with LLMs, Generative AI, Agentic AI, or AI-assisted engineering workflows.
Experience with API design, microservices, event-driven architecture, or serverless backend development.
Experience with CI/CD pipelines, infrastructure as code, automated testing, and production deployment practices.
Experience with data governance, metadata management, lineage, data observability, or operational controls for enterprise data platforms
ABOUT US
Bristlecone is the leading provider of AI-powered application transformation services for the connected supply chain. We empower our customers with speed, visibility, automation, and resiliency – to thrive on change. Our transformative solutions in Digital Logistics, Cognitive Manufacturing, Autonomous Planning, Smart Procurement and Digitalization are positioned around key industry pillars and delivered through a comprehensive portfolio of services spanning digital strategy, design and build, and implementation across a range of technology platforms. Bristlecone is ranked among the top ten leaders in supply chain services by Gartner. We are headquartered in San Jose, California, with locations across North America, Europe and Asia, and over 2,500 consultants. Bristlecone is part of the $19.4 billion Mahindra Group. EQUAL OPPORTUNITY EMPLOYER: Bristlecone is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status. INFORMATION SECURITY
RESPONSIBILITIES:
• Understand and adhere to Information Security policies, guidelines and procedure, practice them for protection of organizational data and Information System.
• Take part in information security training and act while handling information.
• Report all suspected security and policy breach to InfoSec team or appropriate authority (CISO).
• Understand and adhere to the additional information security responsibilities as part of the assigned job role.
ABOUT US
Bristlecone is the leading provider of AI-powered application transformation services for the connected supply chain. We empower our customers with speed, visibility, automation, and resiliency – to thrive on change. Our transformative solutions in Digital Logistics, Cognitive Manufacturing, Autonomous Planning, Smart Procurement and Digitalization are positioned around key industry pillars and delivered through a comprehensive portfolio of services spanning digital strategy, design and build, and implementation across a range of technology platforms. Bristlecone is ranked among the top ten leaders in supply chain services by Gartner. We are headquartered in San Jose, California, with locations across North America, Europe and Asia, and over 2,500 consultants. Bristlecone is part of the $19.4 billion Mahindra Group. EQUAL OPPORTUNITY EMPLOYER: Bristlecone is an equal opportunity employer. All applicants will be considered for employment without attention to race, color, religion, sex, sexual orientation, gender identity, national origin, veteran or disability status. INFORMATION SECURITY
RESPONSIBILITIES:
• Understand and adhere to Information Security policies, guidelines and procedure, practice them for protection of organizational data and Information System.
• Take part in information security training and act while handling information.
• Report all suspected security and policy breach to InfoSec team or appropriate authority (CISO).
• Understand and adhere to the additional information security responsibilities as part of the assigned job role.