Data Engineer

1 week ago

bangalore, India BayOne Solutions Full time

The Opportunity: We are seeking a highly experienced Data Engineer to join our MarTech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engineering and back-end systems. You will be responsible for leading the development, optimization, and maintenance of both data pipelines and back-end services, ensuring seamless integration within a microservices environment. You'll be responsible for building robust data solutions and crafting the APIs and services that power the customer experience. This role demands a strong understanding of microservices principles, data engineering best practices, back-end development, and experience with building scalable solutions. Responsibilities: Lead the design, development, and deployment of data engineering solutions and back-end services within a microservices environment. Architect and implement scalable data pipelines for ingestion, processing, and storage of data from various sources, ensuring data quality and reliability. Design, code, configure, test, debug, deploy, document, and maintain both data pipelines and back-end web service applications using a variety of software development toolkits, testing/verification applications and other tools, while adhering to specific development best practices and quality standards. Work closely with solution engineers and architects to develop technical design specifications from which programs will be written or configured, with a strong focus on microservices integration for both data and application components. Validate that proposed back-end services and data solutions align with both the architectural design and the business needs, ensuring seamless integration within the existing microservices environment. Responsible for troubleshooting and issue analysis across the back-end stack, including data pipelines, microservices, and APIs, as well as coding, testing, and implementing software enhancements. Implement and maintain data governance and API governance policies and standards across the microservices landscape. Collaborate with cross-functional teams to define data requirements, design APIs, and deliver data-driven services. Available to support/unblock planned deployments during off hours. Contribute to the evolution of our data and application architecture, with a focus on microservices best practices, data engineering principles, and emerging technologies. Lead and mentor other engineers, fostering a culture of innovation and collaboration across both data engineering and back-end development. We are excited about you if you have experience with the following technologies: Git, CI/CD, Jenkins, ArgoCD Scala/Java, SQL/SparkSQL, Python Apache Spark, Databricks, Apache Storm Cosmos DB, Redis, Maven, Gradle Build Tools Kafka Ecosystem, Kafka Streams library, Kafka Avro Schemas Cosmos DB, Redis Cache and Redis Insight Tool Grafana, Grafana Loki Logging Restful API Design Patterns, Swagger Documentation Experience with markup languages such as JSON and YAML Proven experience designing and implementing microservices architectures. Strong understanding of data modeling, data warehousing, and ETL processes. Experience with containerization technologies such as Docker and Kubernetes. Experience with cloud platforms (e.g., AWS, Azure, GCP) and their data engineering and back-end services. Experience with Node.js. Familiarity with Rust is a plus.

  • Senior Data Engineer

    1 day ago

    bangalore, India NTT DATA Full time

    Build scalable ETL/ELT pipelines with Informatica or Spark/PySpark; orchestrate with AWS Glue or Azure ADF/Databricks. Implement cleansing, enrichment, and modeling (dimensional/Data Vault); optimize partitioning, job performance, and cost. Publish curated datasets/semantic layers for Power BI, Tableau, SSRS/SSAS; enable self-service analytics. Automate data...

  • Enterprise Data Architect

    2 weeks ago

    bangalore, India Aptus Data Labs Full time

    Company DescriptionAptus Data Labs is a leading Data and AI company specializing in Pharma, Manufacturing & Supply Chain, Banking & FinTech, and Technology domains. We offer innovative analytical solutions and consulting services to help businesses make quick, data-driven decisions essential for growth and sustainability in evolving industries. Leveraging...

  • Enterprise Data Architect

    2 weeks ago

    bangalore, India Aptus Data Labs Full time

    Company Description Aptus Data Labs is a leading Data and AI company specializing in Pharma, Manufacturing & Supply Chain, Banking & FinTech, and Technology domains. We offer innovative analytical solutions and consulting services to help businesses make quick, data-driven decisions essential for growth and sustainability in evolving industries. Leveraging...

  • Fid Federal Risk Applications Data Engineer

    2 weeks ago

    Bangalore, Karnataka, India NTT DATA Full time

    Req ID 341952 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a FID Federal Risk Applications Data Engineer to join our team in Bangalore Karn taka IN-KA India IN Job Duties Team Profile Our...

  • Fid Federal Risk Applications Data Engineer

    4 days ago

    Bangalore, Karnataka, India NTT DATA Full time

    Req ID 341951 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a FID Federal Risk Applications Data Engineer to join our team in Bangalore Karn taka IN-KA India IN Job Duties Team Profile Our...

  • Senior Data Scientist

    1 week ago

    bangalore, India Enable Data Incorporated Full time

    Enable Data Incorporated is looking for a talented and experienced Senior Data Scientist to join our innovative team. In this role, you will be responsible for driving data science initiatives, developing predictive models, and providing insights that guide key business decisions. The ideal candidate has a strong background in statistical analysis, machine...

  • Senior DevOps Engineer

    6 days ago

    bangalore, India Crest Data Full time

    Company Overview:Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups.Company URL: http://www.crestdata.aiJob Location -...

  • Senior DevOps Engineer

    4 days ago

    bangalore, India Crest Data Full time

    Company Overview:Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups.Company URL: http://www.crestdata.aiJob Location -...

  • Senior DevOps Engineer

    3 weeks ago

    bangalore, India Crest Data Full time

    Company Overview: Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups. Company URL : Job Location - Ahmedabad Job...

  • Senior Leader – Data Architecture

    6 days ago

    bangalore, India Role: Senior Leader – Data Architecture Full time

    We are looking for a *highly seasoned Data Architecture leader* to head our enterprise data architecture function. The ideal candidate is someone who has built and scaled large-scale data platforms and can drive the vision, strategy, and execution of data architecture across the organization.*Key Requirements*1. Deep Technical Expertise in Large-Scale...