Data Engineer

3 weeks ago


Bangalore, India Tata Consultancy Services Full time

Role-Azure Data bricks, Data Engineer

Location-PAN India

Exp-7-12 Years

We are looking for a highly skilled Data Engineer. This position requires excellent communication

and technical skills and involves being knowledgeable about Azure Databrics, Pyspar, SQL, Python,.

Skill Requirements & Experience

- Overall 8+ years of work experience in Data Warehouse(DWH) Development
- Experience in AzureDatabricks, Pyspark, Python , SQL
- Hands on exp in Azure data factory, data bricks
- Design, implement, and manage data solutions on Azure
- Develop and maintain data pipelines using Databricks
- Ensure efficient data storage and retrieval using Azure Storage and Data Lake
- Automate infrastructure and application deployments with Ansible
- Write clean, maintainable code in Python
- Collaborate with team members using Git and GitLab for version control and CI/CD
- Gather and document business requirements through stakeholder interviews and workshops
- Analyze and translate business needs into technical specifications
- Apply data analytics to interpret data and support business decisions
- Communicate effectively with stakeholders to manage expectations and provide project updates
- Continuously seek opportunities to improve processes and drive efficiency
- Share and contribute: Support and guide less senior team members, contribute to team spirit and dynamic growth, actively participate in wider engineering group- and product-wide activities
- Extensive experience in end-to-end implementation of DWH projects, especially in data warehouse and mart developments
- Good understanding of Data integration, Data Quality and data architecture
- Review modifications to existing software to improve efficiency and performance
- Experience in Star/ Snowflake/ Dimensional data modelling and Data Warehouse
- Work with the Application Development team to implement data strategies, build data flows and develop conceptual data models
- Create logical and physical data models using best practices to ensure high data quality and reduced redundancy.
- Optimize and update logical and physical data models to support new and existing projects
- Maintain conceptual, logical and physical data models along with corresponding metadata
- Recommend opportunities for reuse of data models in new environments
- Evaluate data models and physical databases for variances and discrepancies
- Validate business data objects for accuracy and completeness
- Analyze data-related system integration challenges and propose appropriate solutions
- Develop data models according to company standards

Having experience in insurance domain is advantage


  • Data Engineer

    4 days ago


    bangalore, India IntraEdge Full time

    *Job Title*: Data Engineer*Location*: Bangalore*Experience*: 5+ years---### *Job Description:*We are looking for an experienced *Data Engineer* to join our dynamic team. In this role, you will leverage your expertise in building and optimizing data systems, and you will work closely with cross-functional teams to support data-driven initiatives. If you have...

  • Data Engineer

    6 days ago


    bangalore, India Polestar Solutions & Services Full time

    About Polestar Solutions:Polestar, is a leading AI & analytics solutions company that serves Fortune 1000 companies, startups and the government across various industries, including CPG & retail, manufacturing and pharmaceuticals, among others. Headquartered in Texas, we have branches across Noida, Kolkata, Mumbai, Bangalore, and the UK.Our comprehensive...

  • Data Engineer

    3 days ago


    bangalore, India Response Informatics Full time

    LOCATION- Bangalore EXPERIENCE- 5+YEARS Azure Data Engineer : Experience:  5+ years of experience in data engineering, with a focus on cloud-based solutions.  Extensive experience with Azure and its data services, including BigQuery, Dataflow, Pub/Sub, Cloud Storage, and Cloud Composer.  Experience with ETL tools and processes.  Design, develop,...

  • Data Engineer

    4 weeks ago


    bangalore, India nexocean Full time

    Job Description Utilizes software engineering principles to deploy and maintain fully automated data transformation pipelines that combine a large variety of storage and computation technologies to handle a distribution of data types and volumes in support of data architecture design. A Senior Data Engineer designs and oversees the entire data...

  • Data Engineer

    1 week ago


    Bangalore, India Amazon Full time

    Amazon Prime team is building an evergreen platform that will provide real time insights of traffic, sales, deals, prime engagement and is looking for rock start data engineer to build this. At Amazon Prime, understanding customer data is paramount to our success in providing customers with relevant and enticing benefits such as fast free shipping, instant...

  • Data Engineer

    4 days ago


    bangalore, India Giant Eagle GCC Full time

    Data Engineer Grow. Learn. Thrive. Giant Eagle is where your career can soar high. At Giant Eagle, you are so much more than an employee. You are part of the Family. About the Company Since our founding in 1931, Giant Eagle, Inc. has evolved into one of the top 40 largest private corporations in the U.S. and one of the country’s largest food retailers...

  • Data Engineer

    3 weeks ago


    Bangalore, India Straive Full time

    About Straive: Straive (earlier known as SPi Global) is a market leading content solutions company providing content creation services, course design, data operations and platform-based technology solutions. Ed-Tech, Data Solutions, Research and Education Content Services form the core pillars of the company’s long-term vision. With the acquisition of...

  • Data Engineer

    3 weeks ago


    Bangalore, India Straive Full time

    About Straive: Straive (earlier known as SPi Global) is a market leading content solutions company providing content creation services, course design, data operations and platform-based technology solutions. Ed-Tech, Data Solutions, Research and Education Content Services form the core pillars of the company’s long-term vision. With the acquisition of...

  • Data Engineer

    3 days ago


    bangalore, India CoffeeBeans Full time

    About company Founded in the year 2017, CoffeeBeans specialises in offering high end consulting services in technology, product, and processes. We help our clients attain significant improvement in quality of delivery through impactful product launches, process simplification, and help build competencies that drive business outcomes across industries. The...

  • Data Engineer

    3 days ago


    bangalore, India Sigmoid Full time

    Job Title: Data Engineer-Technical Lead Location: Bangalore Job Type: Full-time Kindly find the Job Description Below and please share the details along with your resume to proceed further. About the Role: We are looking for a skilled Data Engineer with 6+ years of experience in big data technologies, particularly Java/Python, Apache Spark, SQL and data...

  • AI Engineer Lead

    4 weeks ago


    Bangalore, India Aptus Data Labs Full time

    Aptus Data Labs Aptus Data Labs is a leading Data and AI company specializing in the Pharma, Manufacturing & Supply Chain, Banking & FinTech, and Technology domains. We offer innovative analytical solutions and consulting services to help businesses make quick, data-driven decisions essential for growth and sustainability in evolving industries. Role- Lead...

  • Data Engineer

    4 days ago


    bangalore, India CoffeeBeans Full time

    About companyFounded in the year 2017, CoffeeBeans specialises in offering high end consulting services in technology, product, and processes. We help our clients attain significant improvement in quality of delivery through impactful product launches, process simplification, and help build competencies that drive business outcomes across industries. The...

  • Data Engineer

    4 days ago


    bangalore, India Amplify Analytix Full time

    Company OverviewAs a Data Science for Business company, we at Amplify Analytix help our clients make the most of their data using the latest methodologies. We work across a variety of domains such as healthcare, manufacturing, consumer electronics, and luxury retail. We develop data-driven analytics and solutions to tackle fundamental business problems like...

  • Data Engineer

    4 days ago


    bangalore, India ValueLabs Full time

    Job Title: Pyspark Developer Experience: 5+ Years Location: Dubai Notice Period: Immediate to 30 Days About Us: ValueLabs is a global technology services company empowering businesses through innovative solutions and services. With expertise in AI, cloud, and cybersecurity, we deliver cutting-edge solutions that drive growth and efficiency. Education...

  • Data Engineer

    3 days ago


    bangalore, India Recro Full time

    Hi , We are looking for Data Engineers for Bengaluru Location Position :- Data engineer Skill Sets :- Spark, scala ,hadoop, Python or pyspark, GCP or Azure Experience :- 6.5-11 years Location :- Bengaluru Design and develop data-ingestion frameworks, real-time processing solutions, and data processing and transformation frameworks. Deploy and provide support...

  • Data Engineer

    10 hours ago


    bangalore, India Visa Full time

    Job Description The Senior Data Engineer role will coordinate with other teams to manage and prioritize projects, and driving the strategy, roadmap, and execution of key data engineering initiatives. The role requires understanding and translating business needs into data models, creating robust data pipelines, and developing and maintaining data lakes. It...

  • Data Engineer

    4 days ago


    bangalore, India Ambition Full time

    Job DescriptionOur client, a leading global hedge fund, is seeking a Data Engineer to join their high-performance team focused on building an advanced data platform. The position is based in Bangalore and will require relocation.RequirementsPh.D., Master’s, or Bachelor’s degree in Computer Science, Mathematics, or a related fieldOver 5 years of practical...

  • Data Engineer

    11 hours ago


    bangalore, India Response Informatics Full time

    LOCATION-Bangalore EXPERIENCE- 5+YEARS Azure Data Engineer : Experience:  5+ years of experience in data engineering, with a focus on cloud-based solutions.  Extensive experience with Azure and its data services, including BigQuery, Dataflow, Pub/Sub, Cloud Storage, and Cloud Composer.  Experience with ETL tools and processes.  Design, develop,...

  • Data Engineer

    4 days ago


    bangalore, India CoffeeBeans Full time

    Founded in the year 2017, CoffeeBeans specialises in offering high end consulting services in technology, product, and processes. We help our clients attain significant improvement in quality of delivery through impactful product launches, process simplification, and help build competencies that drive business outcomes across industries. The company uses...


  • Bangalore, India Visa Full time

    Job DescriptionPrimary ResponsibilitiesDesign: Lead the data pipeline designs as per the defined architecture of the metric repository, using/building re-usable functions and frameworks ensuring scalability, reliability and performance.Data Analysis: Understand the metric definitions, perform the analysis and lead the discussions with the requestors from...