Data engineer

4 days ago

Kanpur, India BayOne Solutions Full time

The Opportunity: We are seeking a highly experienced Data Engineer to join our Mar Tech team and play a pivotal role in driving innovation within our microservices architecture, with a strong emphasis on data engineering and back-end systems. You will be responsible for leading the development, optimization, and maintenance of both data pipelines and back-end services, ensuring seamless integration within a microservices environment. You'll be responsible for building robust data solutions and crafting the APIs and services that power the customer experience. This role demands a strong understanding of microservices principles, data engineering best practices, back-end development, and experience with building scalable solutions. Responsibilities: Lead the design, development, and deployment of data engineering solutions and back-end services within a microservices environment. Architect and implement scalable data pipelines for ingestion, processing, and storage of data from various sources, ensuring data quality and reliability. Design, code, configure, test, debug, deploy, document, and maintain both data pipelines and back-end web service applications using a variety of software development toolkits, testing/verification applications and other tools, while adhering to specific development best practices and quality standards. Work closely with solution engineers and architects to develop technical design specifications from which programs will be written or configured, with a strong focus on microservices integration for both data and application components. Validate that proposed back-end services and data solutions align with both the architectural design and the business needs, ensuring seamless integration within the existing microservices environment. Responsible for troubleshooting and issue analysis across the back-end stack, including data pipelines, microservices, and APIs, as well as coding, testing, and implementing software enhancements. Implement and maintain data governance and API governance policies and standards across the microservices landscape. Collaborate with cross-functional teams to define data requirements, design APIs, and deliver data-driven services. Available to support/unblock planned deployments during off hours. Contribute to the evolution of our data and application architecture, with a focus on microservices best practices, data engineering principles, and emerging technologies. Lead and mentor other engineers, fostering a culture of innovation and collaboration across both data engineering and back-end development. We are excited about you if you have experience with the following technologies: Git, CI/CD, Jenkins, Argo CD Scala/Java, SQL/Spark SQL, Python Apache Spark, Databricks, Apache Storm Cosmos DB, Redis, Maven, Gradle Build Tools Kafka Ecosystem, Kafka Streams library, Kafka Avro Schemas Cosmos DB, Redis Cache and Redis Insight Tool Grafana, Grafana Loki Logging Restful API Design Patterns, Swagger Documentation Experience with markup languages such as JSON and YAML Proven experience designing and implementing microservices architectures. Strong understanding of data modeling, data warehousing, and ETL processes. Experience with containerization technologies such as Docker and Kubernetes. Experience with cloud platforms (e.g., AWS, Azure, GCP) and their data engineering and back-end services. Experience with Node.js. Familiarity with Rust is a plus.

  • Data Engineer

    3 days ago

    Kanpur, India JIT Global Infosystems Pvt. Ltd. Full time

    Company Description:JIT Global Infosystems Pvt. Ltd. delivers comprehensive Applications, Analytics, and Consulting services to clients worldwide. By combining technological expertise with deep domain knowledge, we ensure tangible improvements in business performance. Our experienced global leadership team utilizes an innovative delivery model to cater to a...

  • Data Engineer

    3 days ago

    Kanpur, India JIT Global Infosystems Pvt. Ltd. Full time

    Company Description:JIT Global Infosystems Pvt. Ltd. delivers comprehensive Applications, Analytics, and Consulting services to clients worldwide. By combining technological expertise with deep domain knowledge, we ensure tangible improvements in business performance. Our experienced global leadership team utilizes an innovative delivery model to cater to a...

  • Data Engineer

    2 weeks ago

    Kanpur, India Intellify Solutions Full time

    Requirements: ● Required: Bachelor’s degree or relevant experience ● Required: 3-5+ years of prior experience as a software engineer or data engineer in a fast-paced, technical, problem-solving environment ● Required: Cloud Data Warehouse experience - Snowflake ● Required: Expert in Advanced SQL ● Required: 2-3 years Experience with data...

  • Data Engineer

    2 weeks ago

    Kanpur, India Collabera Full time

    Data EngineerREMOTE, INDIADay to day:As a Data Engineer, you will design, build, and maintain data products such as pipelines, models, APIs, and visualizations using best-in-class tools and DataOps practices. Your role involves creating scalable solutions that integrate machine learning and AI capabilities, implementing software engineering standards like...

  • Data Engineer

    4 weeks ago

    Kanpur, India Veraxion Full time

    We’re looking foraData Engineerto design, build, and scale modern data platforms onAWS . You’ll work withPython, Spark, DBT, and AWS-native servicesin an Agile environment to deliver scalable, secure, and high-performance data solutions.What you’ll do Develop and optimizeETL/ELT pipelineswith Python, DBT, and AWS services (Data Ops Live). Build and...

  • Senior Data Engineer

    4 days ago

    Kanpur, Uttar Pradesh, India appsierra Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Data Engineering and Infrastructure: 6+ years of experience in a Data Engineering role, designing, building, and managingscalable and reliable data systems.Proficient with big data and stream-processing technologies such as Spark and Kafka.Hands-on experience with cloud platforms, particularly AWS services like EC2 and RDS.Skilled in building and...

  • Senior data engineer

    2 weeks ago

    Kanpur, India HealthyMe AI Full time

    About the RoleWe are seeking a Senior Data Engineer with deep expertise in building data pipelines and integrating healthcare data. You will report to the Head of AI and Engineering and be responsible for designing, building, and operating the backbone of our AI-powered applications. This is a critical role where you will create scalable pipelines that...

  • Data Warehouse Engineer

    1 week ago

    Kanpur, Uttar Pradesh, India Umanist Staffing Full time ₹ 8,00,000 - ₹ 24,00,000 per year

    Job Summary:We are looking for a skilled Data Warehouse Engineer to design, build, and optimize large-scale data warehouse and analytics solutions. The candidate must have deep expertise in data modeling, ETL development, SQL optimization, and cloud-based data platforms.Key Responsibilities:Design and develop data warehouse architecture, ETL pipelines, and...

  • Senior Data Engineer

    2 days ago

    Kanpur, India Tata Consultancy Services Full time

    TCS is Looking for a Senior Data Engineer in Noida/Bhubaneswar and Kochi . Please go through the JD below and share your resume with the below mentioned details if you wish to apply.Senior Data EngineerLocation: Noida/Bhubaneswar or KochiExp. Needed: Min 8 to 12 years of exp.Must Have Skills :: Data Engineer, Apache Spark, ScalaRole Summary:We're seeking...

  • Senior Data Engineer

    8 hours ago

    Kanpur, India Tata Consultancy Services Full time

    TCS is Looking for a Senior Data Engineer in Noida/Bhubaneswar and Kochi . Please go through the JD below and share your resume with the below mentioned details if you wish to apply.Senior Data EngineerLocation: Noida/Bhubaneswar or KochiExp. Needed: Min 8 to 12 years of exp.Must Have Skills :: Data Engineer, Apache Spark, ScalaRole Summary:We're seeking...