Data Engineer

4 days ago

Bangalore Urban, India Tata Consultancy Services Full time

Greetings from TCS Job Title: Azure Data Engineer Required Skillset: AWS(preferable)/AZURE Databricks Location: PAN INDIA Experience Range: 5-14 years Job Description: Must Have: Experience: More than 4 years in data integration, pipeline development, and data warehousing, with a strong focus on AWS/AZURE Databricks. Proficiency in Databricks platform, management, and optimization. Strong experience in AWS/AZURE Cloud, particularly in data engineering and administration, with expertise in Apache Spark/Azure Synapse Analytics Spark pool, S3, Athena, Glue/AZURE Data factory, Kafka, Lambda/Azure functions, Redshift, and RDS. Proven experience in data engineering performance tuning and analytical understanding in business and program contexts. Solid experience in Python development, specifically in pySpark within the AWS/AZURE Cloud environment, including experience with Terraform. Knowledge of databases (Oracle, SQL Server, PostgreSQL, Redshift, MySQL, or similar) and advanced database querying. Experience with source control systems (Git, Bitbucket) and Jenkins for build and continuous integration. Understanding of continuous deployment (CI/CD) processes. Experience with Airflow and additional Apache Spark knowledge is advantageous. Exposure to ETL tools, including Informatica. Good To Have: Experience with Airflow and additional Apache Spark knowledge is advantageous. Exposure to ETL tools, including Informatica. Key Responsibilities: Administer, manage, and optimize the Databricks environment to ensure efficient data processing and pipeline development. Perform advanced troubleshooting, query optimization, and performance tuning in a Databricks environment. Collaborate with development teams to guide, optimize, and refine data solutions within the Databricks ecosystem. Ensure high performance in data handling and processing, including the optimization of Databricks jobs and clusters. Engage with and support business teams to deliver data and analytics projects effectively. Thanks & Regards, Ria Aarthi A.

  • Data Engineer

    2 weeks ago

    Bangalore Urban, India ACL Digital Full time

    Hi all, We are hiring for Data Engineer with one of our renowned client with pan India location.Looking for candidates with 5 to 7 years of experienceRelevant 5+ years into Data Engineering GCP Cloud Data bricks,Unity catalog, Python/Pyspark Terra form scripts

  • Data Engineer

    2 weeks ago

    Bangalore Urban, India ACL Digital Full time

    Hi all, We are hiring for Data Engineer with one of our renowned client with pan India location. Looking for candidates with 5 to 7 years of experience Relevant 5+ years into Data Engineering GCP Cloud Data bricks, Unity catalog, Python/Pyspark Terra form scripts

  • Data Engineer

    2 weeks ago

    Bangalore Urban, India Synechron Full time

    Good-day,We have immediate opportunity for Data Engineer (Python, Spark/Scala).Job Role: Data Engineer (Python, Spark/Scala)Job Location: Bangalore Experience-5 to 10 yearsNotice Period: Immediate joiner only.About Company:At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines creativity...

  • Data Engineer

    3 weeks ago

    Bangalore Urban, India Synechron Full time

    Good-day, We have immediate opportunity for Data Engineer (Python, Spark/Scala) . Job Role: Data Engineer (Python, Spark/Scala) Job Location: Bangalore Experience- 5 to 10 years Notice Period: Immediate joiner only. About Company: At Synechron, we believe in the power of digital to transform businesses for the better. Our global consulting firm combines...

  • Data Engineer

    6 days ago

    Bangalore Urban, India Tata Consultancy Services Full time

    Greetings from TCS!Job Title: Azure Data EngineerRequired Skillset: AWS(preferable)/AZURE DatabricksLocation: PAN INDIAExperience Range: 5-14 yearsJob Description:Must Have:Experience: More than 4 years in data integration, pipeline development, and data warehousing, with a strong focus on AWS/AZURE Databricks.Proficiency in Databricks platform, management,...

  • Data Engineer

    4 weeks ago

    Bangalore Urban, India V2Soft Full time

    Data Engineer :8+year experience in design and development of streaming data pipelines.Experience to deal with large stream volumes.Implementation experience ( atleast couple of projects ) in MSK/Flink/Spark/Scala. Very good knowledge on atleast 3 out of the 4 technologiesDesirable experience in Databricks, Snowflake or any data warehouse...

  • Data Engineer

    4 weeks ago

    Bangalore Urban, India V2Soft Full time

    Data Engineer : 8+year experience in design and development of streaming data pipelines. Experience to deal with large stream volumes. Implementation experience ( atleast couple of projects ) in MSK/Flink/Spark/Scala. Very good knowledge on atleast 3 out of the 4 technologies Desirable experience in Databricks, Snowflake or any data warehouse technologies....

  • Data Engineer

    2 weeks ago

    Bangalore Urban, India SatSure Full time

    As a Data Engineer specializing in geospatial data, your primary responsibility is to design, build, and maintain data infrastructure and systems that handle geospatial information effectively. You will work closely with cross-functional teams, including data scientists, geospatial analysts, and software engineers, to ensure that geospatial data is...

  • Data Engineer

    3 weeks ago

    Bangalore Urban, India Tata Consultancy Services Full time

    Opening - PUNE/Bangalore/Hyd/ChennaiAbout the RoleRole - Data Engineer - Quantexa ,Big Data Hadoop, Spark and ScalaResponsibilitiesDevelop Spark and SCALA code as per requirement.Build efficient and optimized ETLs for data ingestion/transformations.Should be able to customize and update the Quantexa UI as per business requirement.Documentation of the...

  • Senior Data Engineer

    3 weeks ago

    Bangalore Urban, India Tata Consultancy Services Full time

    Greetings from TCS!!! TCS has been a great pioneer in feeding the fire of Techies like you. We are a global leader in the technology arena and there’s nothing that can stop us from growing together. Your role is of key importance, as it lays down the foundation for the entire project. Make sure you have a valid EP number before the interview. To create an...