Data engineer

2 days ago

Bharatpur, India One Tapp Consulting Full time

Location - Bengaluru Experience : 2+ years Key Responsibilities: * Design and Development: Design, build, and maintain robust, scalable, and optimized ETL/ELT data pipelines using Python and standard data warehousing principles. * Data Platform Management: Implement and manage data processing jobs and workflows within the Databricks platform, leveraging Spark (Py Spark) for large-scale data transformation. * Data Modeling and Querying: Develop complex and efficient SQL queries, stored procedures, and optimize database performance; contribute to the design and implementation of dimensional and relational data models. * Code Quality and Automation: Ensure high standards of code quality, testing, and documentation; implement CI/CD practices and automation for data workflows. * Collaboration: Work closely with Data Scientists, Analysts, and other software engineers to understand data requirements and deliver solutions that meet business needs. * Monitoring and Optimization: Monitor data pipeline performance, troubleshoot issues, and implement necessary optimizations to ensure data accuracy and timely delivery. Required Qualifications * Experience: Minimum of 2 years of professional experience in a Data Engineering, BI Engineering, or similar role. Technical Expertise (Must-Haves): * Expert proficiency in writing complex, optimized SQL queries and experience with various relational databases (e.g., Postgre SQL, SQL Server, My SQL). * Expert proficiency in Python for data manipulation, scripting, and pipeline development (experience with libraries like Pandas, Num Py is a plus). * Demonstrated experience and strong working knowledge of the Databricks platform, including Delta Lake, Spark (Py Spark), and notebook-based development. * Data Concepts: Solid understanding of data warehousing concepts, data modeling (e.g., Star Schema, Snowflake Schema), and ETL/ELT processes. * Communication: Excellent communication and collaboration skills, with the ability to explain complex technical concepts to non-technical stakeholders.

  • Data Engineer

    2 weeks ago

    Bharatpur, India Whatjobs IN C2 Full time

    Job Title: Azure Data Engineer Location: Bangalore (Hybrid) Experience: 5-10 Years (STRICTLY) Employment Type: Full-Time / Permanent Notice Period: Immediate to 15 Days Preferred Interview Mode : F2F About the Company Our client is a leading financial technology transformation partner helping global banks and financial institutions streamline their lending...

  • Palantir data engineer

    2 days ago

    Bharatpur, India SageBeans RPO Full time

    Job Title: Lead Data Engineer Location: Remote work in India Job Type: Contract 6 Months Experience and skills required for the Palantir Forward Deployed Engineer, Palantir FDE Strong programming skills in Python, SQL and optionally Java/Scala. Hands on experience with Palantir Foundry tools including: Code repositories, Pipeline Builder, Code workbook....

  • Data Quality Engineer

    2 weeks ago

    Bharatpur, India Whatjobs IN C2 Full time

    Looking for Data Quality Engineer| Bangalore to join a team of rockstar developers. The candidate should have a minimum of 8+yrs of experience. About CodeVyasa: CodeVyasa is a mid-sized product engineering company that works with top-tier product/solutions companies such as McKinsey, Walmart, RazorPay, Swiggy, and others. We are about 550+ people strong and...

  • Data Engineer Ii

    2 weeks ago

    Bharatpur, India Whatjobs IN C2 Full time

    Job Summary: Building on the foundation of the SDE-I role, the DE- II position takes on a greater level of responsibility and leadership. You'll play a crucial role in driving the evolution and efficiency of our data collection and analytics platform, capable of handling terabyte-scale data and billions of data points. Key Responsibilities Lead the design,...

  • GCP Lead Data Engineer

    1 week ago

    Bharatpur, India People Prime Worldwide Full time

    Lead Data Engineer – Python & GCPLocation - 10+ YearsJob Overview:We are seeking an experienced Lead Data Engineer with strong expertise in Python and Google Cloud Platform (GCP). The ideal candidate will lead the end-to-end data engineering lifecycle—from requirement gathering and solution design to development, deployment, and post-delivery support....

  • Ai/Ml & Data Engineer

    4 weeks ago

    Bharatpur, India Whatjobs IN C2 Full time

    About the Job We are looking for an experienced AI/ML & Data Engineer to design, develop, and deploy scalable machine learning models and data infrastructure on AWS. You will work closely with cross-functional teams to deliver AI-driven solutions, integrate large language models (LLMs), and optimize data workflows while ensuring security, scalability, and...

  • Azure Data Engineer

    2 weeks ago

    Bharatpur, India Tata Consultancy Services Full time

    Greetings from TCS! TCS has always been in the spotlight for being adept in the next big technologies. What we can offer you is a space to explore varied technologies and quench your techie soul. We are hiring Databricks Engineer role Role: Azure Data Engineer Required Skill: Azure Databricks using Scala, PySpark, Azure cloud Platform. Experience: 5-10 years...

  • Chief Data Infrastructure Specialist

    24 hours ago

    bharatpur, India beBeeDataEngineering Full time

    About Our PositionThis is a senior-level data engineering role that involves designing, developing, and maintaining large-scale data pipelines utilizing various technologies such as Python, Kafka, Apache Flink/Spark, and Hudi/Iceberg.Key ResponsibilitiesDesigning and running real-time data streaming systems using Kafka and Flink/Spark Streaming.Deploying...

  • Senior Cloud Data Architect

    3 days ago

    bharatpur, India beBeeDataEngineer Full time

    Job OverviewWe're seeking an exceptional Data Engineer to craft, build, and optimize large-scale data pipelines and platforms.Develop, optimize, and maintain ETL/ELT pipelines using Python and PySpark.Design scalable data workflows on cloud-based platforms such as AWS (Glue, EMR, Lambda, S3, Redshift) or Snowflake.Work with extensive datasets to perform data...

  • Fullstack Engineer

    2 weeks ago

    Bharatpur, India Sonata Software Full time

    GreetingsWe are hiring Fullstack Dotnet Developers. Please find below the JD and send your profile to ramesh@sonata-software.com/Gladwyn.Samuel@sonata-software.com.Sonata Software Overview:In today's market, there is a unique duality in technology adoption. On one side, extreme focus on cost containment by clients, and on the other, deep motivation to...