Data Engineer

3 days ago

bangalore, India Weekday AI Full time

This role is for one of the Weekday's clientsSalary range: Rs Rs ie INR 20-45 LPA)Min Experience: 2 yearsLocation: BengaluruJobType: full-timeWe are seeking a passionate and skilled Data Engineer with 2–5 years of experience to join our dynamic data team. The ideal candidate will have hands-on experience with Big Data technologies, Databricks, Data Lakes, and Data Modeling, along with strong monitoring and performance optimization expertise using Datadog. You will play a key role in designing, building, and maintaining scalable data pipelines and architectures to support business intelligence, analytics, and data-driven decision-making across the organization.RequirementsKey Responsibilities: Design, build, and maintain data pipelines to ingest, transform, and deliver structured and unstructured data from various sources to the enterprise data lake and downstream systems. Develop and optimize data models (both logical and physical) that support analytics and reporting needs across teams. Implement and manage data lakes and data warehouses using modern data engineering tools and frameworks to ensure data consistency, reliability, and performance. Leverage Databricks for big data processing, transformation, and advanced analytics, ensuring efficient data workflows and reusability of code and components. Monitor and optimize data pipeline performance using Datadog, setting up alerts, dashboards, and logging to ensure data systems operate at peak performance. Collaborate with data analysts, scientists, and software engineers to understand data requirements and translate them into scalable engineering solutions. Ensure data governance, quality, and security by implementing best practices in metadata management, lineage tracking, and access controls. Participate in code reviews, documentation, and knowledge-sharing to maintain high standards of data engineering practices. Continuously evaluate emerging technologies and tools to enhance the data ecosystem's performance, scalability, and reliability. Required Skills and Qualifications: Bachelor's or Master's degree in Computer Science, Information Technology, Engineering, or a related field. 2–5 years of experience as a Data Engineer or in a similar role. Proven experience with Big Data technologies such as Spark, Hadoop, Hive, or similar frameworks. Strong hands-on experience with Databricks for building and managing scalable data pipelines and transformations. Proficiency in data modeling and understanding of star schema, snowflake schema, and normalization principles. Deep understanding of Data Lakes and Data Lakehouse architectures for managing large-scale datasets. Experience with Datadog for monitoring data workflows, performance tuning, and system observability. Strong programming skills in Python, SQL, or Scala for data transformation and automation. Familiarity with cloud platforms (AWS, Azure, or GCP) and related data services such as S3, ADLS, BigQuery, or Snowflake. Excellent problem-solving and analytical skills, with a keen attention to detail and data accuracy. Strong communication and collaboration skills with cross-functional teams. Preferred Skills: Experience with ETL/ELT tools and workflow orchestration (e.g., Airflow, Prefect). Knowledge of CI/CD practices for data engineering workflows. Exposure to data security, compliance, and governance frameworks.

  • Fid Federal Risk Applications Data Engineer

    3 days ago

    Bangalore, Karnataka, India NTT DATA Full time

    Req ID 341952 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a FID Federal Risk Applications Data Engineer to join our team in Bangalore Karn taka IN-KA India IN Job Duties Team Profile Our...

  • Senior Data Scientist

    3 days ago

    bangalore, India Enable Data Incorporated Full time

    Enable Data Incorporated is looking for a talented and experienced Senior Data Scientist to join our innovative team. In this role, you will be responsible for driving data science initiatives, developing predictive models, and providing insights that guide key business decisions. The ideal candidate has a strong background in statistical analysis, machine...

  • Senior DevOps Engineer

    2 weeks ago

    bangalore, India Crest Data Full time

    Company Overview:Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups.Company URL: http://www.crestdata.aiJob Location -...

  • Senior DevOps Engineer

    2 weeks ago

    bangalore, India Crest Data Full time

    Company Overview: Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups. Company URL : Job Location - Ahmedabad Job...

  • Senior DevOps Engineer

    2 weeks ago

    bangalore, India Crest Data Full time

    Company Overview: Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups. Company URL : Job Location - Ahmedabad Job...

  • Senior DevOps Engineer

    1 week ago

    bangalore, India Crest Data Full time

    Company Overview: Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups. Company URL : Job Location - Ahmedabad Job...

  • Data Engineer

    3 days ago

    bangalore, India Zemoso Technologies Full time

    Job Title: Data EngineerExperience: 5+ YearsLocation: Chennai/Hyderabad/Mumbai/Pune/Bangalore (Hybrid)Key Responsibilities:● Python Proficiency:Demonstrate a strong command of Python programming language, actively contributing to thedevelopment and maintenance of data engineering solutions.● Data Engineering Expertise:Set up and maintain efficient data...

  • Data Engineer

    2 weeks ago

    bangalore, India Recro Full time

    Key Responsibilities include: Data Pipeline Engineering: Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake. AI Data Enablement: Collaborate with AI Consultants to prepare and manage datasets for supervised, unsupervised, and synthetic learning workflows. POC Support:...

  • Data Engineer

    2 weeks ago

    bangalore, India Recro Full time

    Key Responsibilities include:Data Pipeline Engineering: Design, build, and maintain ingestion, transformation, and storage pipelines using Azure Data Factory, Synapse Analytics, and Data Lake.AI Data Enablement: Collaborate with AI Consultants to prepare and manage datasets for supervised, unsupervised, and synthetic learning workflows.POC Support: Implement...

  • Data Engineer

    3 days ago

    bangalore, India YO HR Consultancy Full time

    Data Engineer/Senior Data Engineer Location: Chennai Experience: 2 - 8 Years Role Description The Data Engineer will be responsible for designing and developing data engineering solutions, creating and maintaining data models, building Extract Transform Load (ETL) pipelines, implementing data warehousing, and performing data analytics on large datasets....