Data Engineer Developer

1 month ago

sany, India CGVAK Software AND Exports Limited Full time
Overview: TheDatabricks Spark Developer plays a crucial role in harnessing thepower of data using Databricks and Spark to develop and maintainefficient data pipelines. They are responsible for implementingscalable and reliable solutions that enable datadrivendecisionmaking within the organization.KeyResponsibilities:
  • Designing andimplementing robust ETL processes using Databricks andSpark
  • Developing and optimizing data pipelinesfor largescale data processing
  • Collaboratingwith data engineers and data scientists to support their datainfrastructure needs
  • Building and maintainingdata warehouse solutions to support businessanalytics
  • Performing data modeling andoptimization to ensure efficient data storage andretrieval
  • Troubleshooting and resolvingperformance issues with data infrastructure andpipelines
  • Implementing security and datagovernance best practices within the dataplatform
  • Automating data quality checks andensuring data consistency andaccuracy
  • Collaborating with crossfunctionalteams to understand data requirements and deliversolutions
  • Monitoring and maintaining the healthof data pipelines andinfrastructure
  • Documenting technical design andarchitecture of data solutions
  • Participating incode reviews and providing constructive feedback topeers
  • Staying updated with the latestadvancements in Databricks and Sparktechnologies
  • Providing technical guidance andmentorship to junior teammembers
RequiredQualifications:
  • Bachelors degree inComputer Science Engineering or a relatedfield
  • Proven experience in developing datapipelines using Databricks andSpark
  • Proficiency in ETL processes and datawarehousing concepts
  • Strong SQL skills with theability to write complex queries for data manipulation andanalysis
  • Advanced programming skills in Pythonfor data processing and manipulation
  • Experiencein data modeling and optimizing data storage forperformance
  • Deep understanding of big datatechnologies and distributed computingconcepts
  • Ability to troubleshoot and optimizedata pipeline performance for efficiency andreliability
  • Knowledge of data governancesecurity and compliance bestpractices
  • Excellent communication andcollaboration skills to work effectively in a teamenvironment
  • Strong analytical andproblemsolving abilities to tackle complex data engineeringchallenges
  • Ability to multitask and prioritizetasks in a fastpaced and dynamic workenvironment
  • Experience with cloud platformssuch as AWS Azure or GCP is aplus
  • Certifications in Databricks andSparkrelated technologies aredesirable
  • Experience in Agile developmentmethodologies and version controlsystems

ExperienceRequired:Data Engineeringresource with Databricks (Databricks develops a webbased platformfor working with Spark) experience with Python coding background& SQL

data,spark,datagovernance,data modeling,python,brick

  • Data Engineer Developer

    2 months ago

    Sany, India CGVAK Software AND Exports Limited Full time

    Overview:TheDatabricks Spark Developer plays a crucial role in harnessing thepower of data using Databricks and Spark to develop and maintainefficient data pipelines. They are responsible for implementingscalable and reliable solutions that enable datadrivendecisionmaking within the organization.KeyResponsibilities:Designing andimplementing robust ETL...

  • Data Engineer

    2 months ago

    Sany, India TalentPulse Consultant Full time

    Overview:The role of aData Engineer is crucial in our organization as they areresponsible for developing constructing testing and maintainingarchitectures such as databases and largescale processing systems.They play a key role in optimizing data and building the foundationfor data generation and analytics. Data Engineers work closely withdata scientists to...

  • Data Engineer

    2 months ago

    sany, India TalentPulse Consultant Full time

    Overview: The role of aData Engineer is crucial in our organization as they areresponsible for developing constructing testing and maintainingarchitectures such as databases and largescale processing systems.They play a key role in optimizing data and building the foundationfor data generation and analytics. Data Engineers work closely withdata scientists to...

  • Data engineer

    1 month ago

    sany, India HR Aspiration Full time

    Senior Data Engineer Expreine : 3 10Years WorkLocation :Bangalore MandatorySkills : Data engineer AWS Athena AWSGlueRedshiftDatalakeLakehousePythonSQLServer Must HaveExperience: 6 yearsof handson data engineeringexperience Expertise with AWS services: S3Redshift EMR Glue Kinesis DynamoDB Buildingbatch and realtime data pipelines Python SQLcoding for data...

  • Data Engineer

    3 weeks ago

    Sany, India Expedify Full time

    OverviewExpedify.iois looking for an intelligent and detailoriented Data Engineer tojoin our ever expanding team of data engineering and analytics. Thehire will be responsible for building and optimizing our datapipeline architecture optimizing data flow and suggesting the rightset of tooling for thesame.Ourcandidate will be working directly with the senior...

  • Data Engineer

    2 months ago

    Sany, India BTOSC Infotech Full time

    We are looking for an experienced dataengineer to join our team. You will use various methods totransform raw data into useful data systems. For example you llcreate algorithms and conduct statistical analysis. Overall you llstrive for efficiency by aligning data systems with business goals. To succeed in this data engineering positionyou should have strong...

  • Data Engineer

    1 week ago

    Sany, India Kenan Management Consultants Pvt Ltd Full time

    Job Description Therole requires data ingestion processing and extraction of data to& from Hadoop Cluster only using Informatica BDM. Itrequires extensive experience in ETL SQL Scoop Spark Hive Hadoop& KAFKA. Knowledge of PySpark will bepreferable Job Title DataEngineer Experience Minimum 45 years ofExperience in Development in Informatica Big...

  • Python Data Engineer

    4 weeks ago

    Sany, India SAM Manpower and Career Services LLP Full time

    Role: Python DataEngineer/DeveloperExp: 3 YearsRelevantLocation: PANIndiaPositions: 1Budget: 15LPANotice: Immediate joinersonlyJD:KeyResponsibilities: Lead the development andmaintenance of our Pythonbased data processing and analyticsinfrastructure. Design and implement robust ETLprocesses integrating data from diverse sources.Develop manage and optimize...

  • Python Data Engineer

    1 week ago

    sany, India SAM Manpower and Career Services LLP Full time

    Role: Python DataEngineer/Developer Exp: 3 YearsRelevant Location: PANIndia Positions: 1 Budget: 15LPA Notice: Immediate joinersonly JD: KeyResponsibilities: Lead the development andmaintenance of our Pythonbased data processing and analyticsinfrastructure. Design and implement robust ETLprocesses integrating data from diverse sources. Develop manage and...

  • Data Engineer

    2 months ago

    sany, India Bista Univarsal Limited Full time

    Overview: The DataEngineer plays a crucial role in our organization by designingdeveloping and maintaining scalable data architecture for ourdataintensive applications. They work closely with data scientistsanalysts and other stakeholders to ensure efficient data flow andutilization across the organization.KeyResponsibilities: Design andimplement scalable...

  • Consultant Data Engineering

    4 weeks ago

    sany, India Tekwissen India Full time

    Overview TekWissen Group isa workforce management provider operating throughout India andseveral other countries worldwide. The client below is a leadingtechnology company offering a range of IT solutions to businessesand organizations enabling them to transform their digital futures Position: ConsultantData Engineering Location: Bangalore ...

  • Consultant Data Engineering

    4 weeks ago

    Sany, India Tekwissen India Full time

    Overview TekWissen Group isa workforce management provider operating throughout India andseveral other countries worldwide. The client below is a leadingtechnology company offering a range of IT solutions to businessesand organizations enabling them to transform their digital futures Position: ConsultantData Engineering Location: Bangalore ...

  • Consultant Data Engineering

    7 days ago

    sany, India Tekwissen India Full time

    Overview TekWissen Group isa workforce management provider operating throughout India andseveral other countries worldwide. The client below is a leadingtechnology company offering a range of IT solutions to businessesand organizations enabling them to transform their digital futures Position: ConsultantData Engineering Location: Bangalore ...

  • Advisor Data Engineering

    1 week ago

    Sany, India Tekwissen India Full time

    Overview TekWissen Group is a workforce managementprovider operating throughout India and several other countriesworldwide. The client below is a leading technology companyoffering a range of IT solutions to businesses and organizationsenabling them to transform their digital futures Position: Advisor Data Engineering Location: Remote Duration:...

  • Advisor Data Engineering

    1 week ago

    sany, India Tekwissen India Full time

    Overview TekWissen Group is a workforce managementprovider operating throughout India and several other countriesworldwide. The client below is a leading technology companyoffering a range of IT solutions to businesses and organizationsenabling them to transform their digital futures Position: Advisor Data Engineering Location: Remote ...

  • Snowflake Data Engineer

    1 week ago

    sany, India Agilite Global Solutions Company Full time

    Role: Snowflakes DataEngineer Location: India Remote Work from Anywhere inIndiaMinimum Qualification: Bachelors degree or higher in thetechnologyfield.IndicativeExperience: 3 YearsDomain: USHealthCare.Customer Profile: Captive research and development pods for a 500millionmember group of pharma data research companies that helppatients gain access to...

  • AWS Data Engineer

    1 month ago

    sany, India TalentPulse Consultant Full time

    Overview: The AWS DataEngineer plays a crucial role in our organization by designing andimplementing scalable reliable and secure data solutions in the AWScloud environment. They are responsible for developing andmaintaining data pipelines optimizing data workflows and ensuringthe quality and integrity of our data. This position is essentialfor leveraging...

  • AWS Data Engineer

    2 months ago

    Sany, India TalentPulse Consultant Full time

    Overview:The AWS DataEngineer plays a crucial role in our organization by designing andimplementing scalable reliable and secure data solutions in the AWScloud environment. They are responsible for developing andmaintaining data pipelines optimizing data workflows and ensuringthe quality and integrity of our data. This position is essentialfor leveraging...

  • AWS Data Engineer

    1 week ago

    Sany, India TalentPulse Consultant Full time

    Overview:The AWS DataEngineer plays a crucial role in our organization by designing andimplementing scalable reliable and secure data solutions in the AWScloud environment. They are responsible for developing andmaintaining data pipelines optimizing data workflows and ensuringthe quality and integrity of our data. This position is essentialfor leveraging...

  • Databricks Data Engineer

    2 months ago

    sany, India BigShyft Full time

    AboutCompany: Our client is aninnovative startup that specializes in data infrastructuresolutions. With a focus on automation and reliability they empowerorganizations to harness the power of their data effectively.Recently acquired their team is expanding and they are seekingtalented individuals to join us in ourmission.JobDescription: As a DatabricksData...