Data Engineer

4 weeks ago

Coimbatore, India CGVAK Software AND Exports Limited Full time
Overview:TheDatabricks Spark Developer plays a crucial role in harnessing thepower of data using Databricks and Spark to develop and maintainefficient data pipelines. They are responsible for implementingscalable and reliable solutions that enable datadrivendecisionmaking within the organization.KeyResponsibilities:
  • Designing andimplementing robust ETL processes using Databricks andSpark
  • Developing and optimizing data pipelinesfor largescale data processing
  • Collaboratingwith data engineers and data scientists to support their datainfrastructure needs
  • Building and maintainingdata warehouse solutions to support businessanalytics
  • Performing data modeling andoptimization to ensure efficient data storage andretrieval
  • Troubleshooting and resolvingperformance issues with data infrastructure andpipelines
  • Implementing security and datagovernance best practices within the dataplatform
  • Automating data quality checks andensuring data consistency andaccuracy
  • Collaborating with crossfunctionalteams to understand data requirements and deliversolutions
  • Monitoring and maintaining the healthof data pipelines andinfrastructure
  • Documenting technical design andarchitecture of data solutions
  • Participating incode reviews and providing constructive feedback topeers
  • Staying updated with the latestadvancements in Databricks and Sparktechnologies
  • Providing technical guidance andmentorship to junior teammembers
RequiredQualifications:
  • Bachelors degree inComputer Science Engineering or a relatedfield
  • Proven experience in developing datapipelines using Databricks andSpark
  • Proficiency in ETL processes and datawarehousing concepts
  • Strong SQL skills with theability to write complex queries for data manipulation andanalysis
  • Advanced programming skills in Pythonfor data processing and manipulation
  • Experiencein data modeling and optimizing data storage forperformance
  • Deep understanding of big datatechnologies and distributed computingconcepts
  • Ability to troubleshoot and optimizedata pipeline performance for efficiency andreliability
  • Knowledge of data governancesecurity and compliance bestpractices
  • Excellent communication andcollaboration skills to work effectively in a teamenvironment
  • Strong analytical andproblemsolving abilities to tackle complex data engineeringchallenges
  • Ability to multitask and prioritizetasks in a fastpaced and dynamic workenvironment
  • Experience with cloud platformssuch as AWS Azure or GCP is aplus
  • Certifications in Databricks andSparkrelated technologies aredesirable
  • Experience in Agile developmentmethodologies and version controlsystems

ExperienceRequired:Data Engineeringresource with Databricks (Databricks develops a webbased platformfor working with Spark) experience with Python coding background& SQL

data,dataengineering,spark

  • Wavicle Data Solutions

    2 weeks ago

    Chennai/Coimbatore, India Wavicle data solutions Full time

    Job Description :- We are seeking a highly experienced Senior and Lead Data Engineer with over 6 years of expertise in data engineering.- As a Lead Data Engineer, you will play a pivotal role in architecting and implementing data solutions.- Your proficiency in Python, PySpark, AWS/Azure, Databricks/Snowflake, SQL, and leadership skills will be crucial for...

  • Data Engineer

    56 minutes ago

    Coimbatore, India Numentica LLC Full time

    This is a remoteposition.As a Salesforce Data Engineer you willbe responsible for designing and implementing data pipelines toextract transform and load (ETL) Salesforce data. You willcollaborate closely with clients to understand their data needs andrequirements and develop customized solutions to normalize cleanseand finetune their Salesforce data. You...

  • Data Engineer

    2 weeks ago

    coimbatore, India Numentica LLC Full time

    This is a remote position. As a Salesforce Data Engineer , you will be responsible for designing and implementing data pipelines to extract, transform, and load (ETL) Salesforce data. You will collaborate closely with clients to understand their data needs and requirements, and develop customized solutions to normalize, cleanse, and fine-tune their...

  • Data Engineer

    2 weeks ago

    Coimbatore, India Numentica LLC Full time

    This is a remote position.As a Salesforce Data Engineer , you will be responsible for designing and implementing data pipelines to extract, transform, and load (ETL) Salesforce data. You will collaborate closely with clients to understand their data needs and requirements, and develop customized solutions to normalize, cleanse, and fine-tune their Salesforce...

  • Data Engineer

    4 days ago

    coimbatore, India CGVAK Software AND Exports Limited Full time

    Overview: TheDatabricks Spark Developer plays a crucial role in harnessing thepower of data using Databricks and Spark to develop and maintainefficient data pipelines. They are responsible for implementingscalable and reliable solutions that enable datadrivendecisionmaking within the organization.KeyResponsibilities: Designing andimplementing robust ETL...

  • Lead Data Engineer

    4 weeks ago

    Coimbatore, India Presidio Full time

    SEIZE THE OPPORTUNITY TO BE A PART OF SOMETHING GREAT! Presidio is on the leading edge of a technology-driven movement to transform the way business is done, for our customers and our customers' customers. Joining Presidio means immersing yourself in a culture of self-starters, collaborators and innovators who make real, lasting change in the marketplace...

  • Azure Data Engineer

    3 weeks ago

    coimbatore, India Numentica LLC Full time

    This is a remoteposition. JobDescription:We are seeking a talentedand experienced Azure Data Engineer to join our team. The idealcandidate will have a strong background in data engineering with afocus on Microsoft Azure services. The candidate should have aminimum of 510 years of handson experience with Azure Data Factory(ADF) Azure Synapse Analytics Synapse...

  • Senior Data Engineer

    4 weeks ago

    coimbatore, India Presidio Full time

    SEIZE THE OPPORTUNITY TO BE A PART OF SOMETHING GREAT! Presidio is on the leading edge of a technology-driven movement to transform the way business is done, for our customers and our customers’ customers. Joining Presidio means immersing yourself in a culture of self-starters, collaborators and innovators who make real, lasting change in the...

  • Senior Data Engineer

    2 weeks ago

    Coimbatore, India Salvo Software Full time

    We are looking for an experienced Automotive Aftermarket Scan Tool Data Engineer to bring onto our team. This position would oversee the management and modification of OEM diagnostic data for the engineering team and advise them on best practices. The person who holds this position will also be responsible for understanding how to integrate this data from...

  • Senior Data Engineer

    2 weeks ago

    coimbatore, India Salvo Software Full time

    We are looking for an experienced Automotive Aftermarket Scan Tool Data Engineer to bring onto our team. This position would oversee the management and modification of OEM diagnostic data for the engineering team and advise them on best practices. The person who holds this position will also be responsible for understanding how to integrate this data from...

  • Senior Data Engineer

    2 weeks ago

    Coimbatore, India Salvo Software Full time

    We are looking for an experienced Automotive Aftermarket Scan Tool Data Engineer to bring onto our team. This position would oversee the management and modification of OEM diagnostic data for the engineering team and advise them on best practices. The person who holds this position will also be responsible for understanding how to integrate this data from...

  • Senior Data Engineer

    4 weeks ago

    Coimbatore, India BlueByte Technologies Full time

    Job Title : Sr. DATA EngineerLocation : CoimbatorePosition Type : Full-Time / 6 months contract to hireKey Responsibilities :Do you love building the infrastructure that fuels data-driven decision making? Are you passionate about wrangling raw data into a usable format? If so, then we want to hear from you!We are searching for a Mid-Level Data Engineer to...

  • Senior Data Engineer

    3 weeks ago

    Coimbatore, Tamil Nadu, India BlueByte Technologies Full time

    Job Title : Sr. DATA EngineerLocation : CoimbatorePosition Type : Full-Time / 6 months contract to hireKey Responsibilities :Do you love building the infrastructure that fuels data-driven decision making? Are you passionate about wrangling raw data into a usable format? If so, then we want to hear from you!We are searching for a Mid-Level Data Engineer to...

  • Senior Data Engineer

    4 weeks ago

    Coimbatore, India BlueByte Technologies Full time

    Job Title : Sr. DATA EngineerLocation : CoimbatorePosition Type : Full-Time / 6 months contract to hireKey Responsibilities :Do you love building the infrastructure that fuels data-driven decision making? Are you passionate about wrangling raw data into a usable format? If so, then we want to hear from you!We are searching for a Mid-Level Data Engineer to...

  • GCP Data Engineer

    4 weeks ago

    Coimbatore, India LTIMindtree Full time

    • 5+ years of applicable engineering experience • Experience in GCP, Big Query • Strong proficiency in Python with an emphasis in building data pipelines • Ability to write complex SQL to perform common types of analysis and aggregations • Experience with Apache Airflow or Google Composer • Detail-oriented and document all the work • Ability to...

  • GCP Data Engineer

    1 month ago

    Coimbatore, India LTIMindtree Full time

    • 5+ years of applicable engineering experience• Experience in GCP, Big Query• Strong proficiency in Python with an emphasis in building data pipelines• Ability to write complex SQL to perform common types of analysis and aggregations• Experience with Apache Airflow or Google Composer• Detail-oriented and document all the work• Ability to work...

  • Senior Data Engineer

    3 weeks ago

    Coimbatore, Tamil Nadu, India PureSearch Full time

    Job Description : We are seeking a talented Senior Data Engineer with 3 to 5 years of experience to join the client's team. The ideal candidate will have strong expertise in SQL and ETL processes using tools such as Pentaho, Talend, Azure Data Factory (ADF), Databricks, or AWS Glue. Familiarity with event-driven architecture patterns such as Lambda,...

  • Senior Data Engineer

    2 weeks ago

    Coimbatore, India PureSearch Full time

    Job Description : We are seeking a talented Senior Data Engineer with 3 to 5 years of experience to join the client's team. The ideal candidate will have strong expertise in SQL and ETL processes using tools such as Pentaho, Talend, Azure Data Factory (ADF), Databricks, or AWS Glue. Familiarity with event-driven architecture patterns such as Lambda,...

  • Senior Data Engineer

    4 weeks ago

    coimbatore, India PureSearch Full time

    Job Description : We are seeking a talented Senior Data Engineer with 3 to 5 years of experience to join the client's team. The ideal candidate will have strong expertise in SQL and ETL processes using tools such as Pentaho, Talend, Azure Data Factory (ADF), Databricks, or AWS Glue. Familiarity with event-driven architecture patterns such as Lambda,...

  • Senior Data Engineer

    2 weeks ago

    Coimbatore, India PureSearch Full time

    Job Description : We are seeking a talented Senior Data Engineer with 3 to 5 years of experience to join the client's team. The ideal candidate will have strong expertise in SQL and ETL processes using tools such as Pentaho, Talend, Azure Data Factory (ADF), Databricks, or AWS Glue. Familiarity with event-driven architecture patterns such as Lambda,...