Data Engineer

4 weeks ago

Bangalore, India Tata Consultancy Services Full time

Greetings from TCS Job Title: Azure Data Engineer Required Skillset: AWS(preferable)/AZURE Databricks Location: PAN INDIA Experience Range: 5-14 years Job Description: Must Have: - Experience: More than 4 years in data integration, pipeline development, and data warehousing, with a strong focus on AWS/AZURE Databricks. - Proficiency in Databricks platform, management, and optimization. - Strong experience in AWS/AZURE Cloud, particularly in data engineering and administration, with expertise in Apache Spark/Azure Synapse Analytics Spark pool, S3, Athena, Glue/AZURE Data factory, Kafka, Lambda/Azure functions, Redshift, and RDS. - Proven experience in data engineering performance tuning and analytical understanding in business and program contexts. - Solid experience in Python development, specifically in pySpark within the AWS/AZURE Cloud environment, including experience with Terraform. - Knowledge of databases (Oracle, SQL Server, PostgreSQL, Redshift, MySQL, or similar) and advanced database querying. - Experience with source control systems (Git, Bitbucket) and Jenkins for build and continuous integration. - Understanding of continuous deployment (CI/CD) processes. - Experience with Airflow and additional Apache Spark knowledge is advantageous. - Exposure to ETL tools, including Informatica. Good To Have: - Experience with Airflow and additional Apache Spark knowledge is advantageous. - Exposure to ETL tools, including Informatica. Key Responsibilities: - Administer, manage, and optimize the Databricks environment to ensure efficient data processing and pipeline development. - Perform advanced troubleshooting, query optimization, and performance tuning in a Databricks environment. - Collaborate with development teams to guide, optimize, and refine data solutions within the Databricks ecosystem. - Ensure high performance in data handling and processing, including the optimization of Databricks jobs and clusters. - Engage with and support business teams to deliver data and analytics projects effectively. Thanks & Regards, Ria Aarthi A.

  • Senior Data Engineer

    2 days ago

    bangalore, India NTT DATA Full time

    Build scalable ETL/ELT pipelines with Informatica or Spark/PySpark; orchestrate with AWS Glue or Azure ADF/Databricks. Implement cleansing, enrichment, and modeling (dimensional/Data Vault); optimize partitioning, job performance, and cost. Publish curated datasets/semantic layers for Power BI, Tableau, SSRS/SSAS; enable self-service analytics. Automate data...

  • Enterprise Data Architect

    2 weeks ago

    bangalore, India Aptus Data Labs Full time

    Company DescriptionAptus Data Labs is a leading Data and AI company specializing in Pharma, Manufacturing & Supply Chain, Banking & FinTech, and Technology domains. We offer innovative analytical solutions and consulting services to help businesses make quick, data-driven decisions essential for growth and sustainability in evolving industries. Leveraging...

  • Enterprise Data Architect

    2 weeks ago

    bangalore, India Aptus Data Labs Full time

    Company Description Aptus Data Labs is a leading Data and AI company specializing in Pharma, Manufacturing & Supply Chain, Banking & FinTech, and Technology domains. We offer innovative analytical solutions and consulting services to help businesses make quick, data-driven decisions essential for growth and sustainability in evolving industries. Leveraging...

  • Fid Federal Risk Applications Data Engineer

    2 weeks ago

    Bangalore, Karnataka, India NTT DATA Full time

    Req ID 341952 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a FID Federal Risk Applications Data Engineer to join our team in Bangalore Karn taka IN-KA India IN Job Duties Team Profile Our...

  • Fid Federal Risk Applications Data Engineer

    5 days ago

    Bangalore, Karnataka, India NTT DATA Full time

    Req ID 341951 NTT DATA strives to hire exceptional innovative and passionate individuals who want to grow with us If you want to be part of an inclusive adaptable and forward-thinking organization apply now We are currently seeking a FID Federal Risk Applications Data Engineer to join our team in Bangalore Karn taka IN-KA India IN Job Duties Team Profile Our...

  • Senior Data Scientist

    1 week ago

    bangalore, India Enable Data Incorporated Full time

    Enable Data Incorporated is looking for a talented and experienced Senior Data Scientist to join our innovative team. In this role, you will be responsible for driving data science initiatives, developing predictive models, and providing insights that guide key business decisions. The ideal candidate has a strong background in statistical analysis, machine...

  • Senior DevOps Engineer

    7 days ago

    bangalore, India Crest Data Full time

    Company Overview:Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups.Company URL: http://www.crestdata.aiJob Location -...

  • Senior DevOps Engineer

    5 days ago

    bangalore, India Crest Data Full time

    Company Overview:Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups.Company URL: http://www.crestdata.aiJob Location -...

  • Senior DevOps Engineer

    4 weeks ago

    bangalore, India Crest Data Full time

    Company Overview: Crest Data is the global leading provider of Data Analytics, Security, DevOps, Cloud Solutions, Software integrations, Analytics, and security-based technological services. With a clientele that includes several Fortune 500 corporations and some of the innovative Silicon Valley Startups. Company URL : Job Location - Ahmedabad Job...

  • Senior Leader – Data Architecture

    7 days ago

    bangalore, India Role: Senior Leader – Data Architecture Full time

    We are looking for a *highly seasoned Data Architecture leader* to head our enterprise data architecture function. The ideal candidate is someone who has built and scaled large-scale data platforms and can drive the vision, strategy, and execution of data architecture across the organization.*Key Requirements*1. Deep Technical Expertise in Large-Scale...