Pyspark Databricks

2 months ago

Hyderabad, India Risk Resources LLP Full time
OverviewThe positionof Pyspark Databricks is crucial to our organization as it involvesdeveloping and implementing data processing pipelines using Pysparkon the Databricks platform ensuring efficient and scalable dataprocessing and analysis.Keyresponsibilities
  • Design and developdata processing pipelines using Pyspark andDatabricks.
  • Optimize and tune the performanceof Spark jobs and clusters.
  • Implement datatransformations and aggregations for analysis andreporting.
  • Collaborate with data engineers anddata scientists to integrate data from various sources into thepipelines.
  • Develop and maintain ETL processesto extract transform and load data into the datalake.
  • Monitor and troubleshoot data processingjobs to ensure reliability andstability.
  • Conduct code reviews and providetechnical guidance to junior teammembers.
  • Implement best practices for datapipeline development and documentation.
  • Workwith crossfunctional teams to gather and analyze requirements fordata processing.
  • Participate in the evaluationand implementation of new technologies related to big dataprocessing.
Requiredqualifications
  • Bachelors degree inComputer Science Engineering or a relatedfield.
  • Proven experience in developing dataprocessing pipelines using Pyspark andDatabricks.
  • Strong proficiency in Pythonprogramming language.
  • Handson experience withBig Data technologies and distributedcomputing.
  • Expertise in optimizing Spark jobsand clusters for performance.
  • Knowledge of ETLprocesses and data warehousingconcepts.
  • Experience with data integration anddata modeling.
  • Ability to troubleshoot anddebug complex data processing issues.
  • Excellentunderstanding of SQL and NoSQLdatabases.
  • Strong communication andcollaboration skills to work effectively in a teamenvironment.
  • Certifications in PysparkDatabricks or related technologies are aplus.
  • Familiarity with cloud platforms such asAWS Azure or Google Cloud isbeneficial.

python,bigdata,etl,spark,data

  • Pyspark Databricks

    2 months ago

    Hyderabad, India Risk Resources LLP Full time

    OverviewThe position of Pyspark Databricks is crucial to our organization as it involves developing and implementing data processing pipelines using Pyspark on the Databricks platform ensuring efficient and scalable data processing and analysis.Key responsibilitiesDesign and develop data processing pipelines using Pyspark and Databricks.Optimize and tune the...

  • Pyspark Databricks

    4 weeks ago

    hyderabad, India Risk Resources LLP Full time

    OverviewThe position of Pyspark Databricks is crucial to our organization as it involves developing and implementing data processing pipelines using Pyspark on the Databricks platform ensuring efficient and scalable data processing and analysis.Key responsibilitiesDesign and develop data processing pipelines using Pyspark and Databricks.Optimize and tune the...

  • Pyspark Databricks

    2 weeks ago

    hyderabad, India Risk Resources LLP Full time

    Overview The position of Pyspark Databricks is crucial to our organization as it involves developing and implementing data processing pipelines using Pyspark on the Databricks platform ensuring efficient and scalable data processing and analysis.Key responsibilities Design and develop data processing pipelines using Pyspark and Databricks. Optimize and tune...

  • Pyspark Databricks Engineer

    2 weeks ago

    Hyderabad, Telangana, India Risk Resources LLP Full time

    Job Title: Pyspark Databricks EngineerJob Summary:We are seeking a highly skilled Pyspark Databricks Engineer to join our team at Risk Resources LLP. The successful candidate will be responsible for designing and developing data processing pipelines using Pyspark and Databricks, optimizing and tuning the performance of Spark jobs and clusters, and...

  • PySpark with Azure Databricks

    3 weeks ago

    Hyderabad, India HTC Global Services Full time

    Dear Candidate, We have an opportunity of PySpark with DataBricks position with HTC Global Services Please share your updated resume on devanshi.nigam@htcinc.com with below details - We are Looking for Immediate or 15days joiners only Candidate's Full Name (As Per Aadhar) - Total Exp. - Rel. Exp. (in Pyspark) - Rel. Exp. (in Databricks) - Notice...

  • PySpark with Azure Databricks

    2 days ago

    hyderabad, India HTC Global Services Full time

    Dear Candidate, We have an opportunity of PySpark with DataBricks position with HTC Global Services Please share your updated resume on devanshi.nigam@htcinc.com with below details - We are Looking for Immediate or 15days joiners only Candidate's Full Name (As Per Aadhar) - Total Exp. - Rel. Exp. (in Pyspark) - Rel. Exp. (in Databricks) - Notice Period- If...

  • PySpark with Azure Databricks

    5 days ago

    hyderabad, India HTC Global Services Full time

    Dear Candidate,We have an opportunity of PySpark with DataBricks position with HTC Global ServicesPlease share your updated resume on with below details -We are Looking for Immediate or 15days joiners onlyCandidate's Full Name (As Per Aadhar) -Total Exp. -Rel. Exp. (in Pyspark) -Rel. Exp. (in Databricks) -Notice Period-If serving Notice or not working,...

  • PySpark with Azure Databricks

    3 days ago

    hyderabad, India HTC Global Services Full time

    Dear Candidate,We have an opportunity of PySpark with DataBricks position with HTC Global ServicesPlease share your updated resume on with below details -We are Looking for Immediate or 15days joiners onlyCandidate's Full Name (As Per Aadhar) -Total Exp. -Rel. Exp. (in Pyspark) -Rel. Exp. (in Databricks) -Notice Period-If serving Notice or not working,...

  • Pyspark Databricks Developer

    3 weeks ago

    Hyderabad, Telangana, India Risk Resources LLP Full time

    About the RoleWe are seeking a highly skilled Pyspark Databricks developer to join our team at Risk Resources LLP. As a key member of our data engineering team, you will be responsible for designing and developing data processing pipelines using Pyspark on the Databricks platform.Key ResponsibilitiesDesign and develop efficient data processing pipelines...

  • Pyspark Databricks Engineer

    3 weeks ago

    Hyderabad, Telangana, India Risk Resources LLP Full time

    Job SummaryWe are seeking a highly skilled Pyspark Databricks engineer to join our team at Risk Resources LLP. The successful candidate will be responsible for designing and developing data processing pipelines using Pyspark on the Databricks platform.Key ResponsibilitiesDesign and develop data processing pipelines using Pyspark and Databricks.Optimize and...

  • PySpark with Azure Databricks

    3 weeks ago

    hyderabad, India HTC Global Services Full time

    Dear Candidate,We have an opportunity of PySpark with DataBricks position with HTC Global ServicesPlease share your updated resume on devanshi.nigam@htcinc.com with below details -We are Looking for Immediate or 15days joiners onlyCandidate's Full Name (As Per Aadhar) -Total Exp. -Rel. Exp. (in Pyspark) -Rel. Exp. (in Databricks) -Notice Period-If serving...

  • PySpark with Azure Databricks

    5 days ago

    Hyderabad, India HTC Global Services Full time

    Dear Candidate,We have an opportunity of PySpark with DataBricks position with HTC Global ServicesPlease share your updated resume on with below details -We are Looking for Immediate or 15days joiners onlyCandidate's Full Name (As Per Aadhar) -Total Exp. -Rel. Exp. (in Pyspark) -Rel. Exp. (in Databricks) -Notice Period-If serving Notice or not working,...

  • PySpark Developer with Databricks Experience

    3 weeks ago

    Hyderabad, Telangana, India HTC Global Services Full time

    Job Opportunity: PySpark with DataBricksWe are seeking a highly skilled PySpark developer with experience in Databricks to join our team at HTC Global Services.Key Responsibilities:Design and develop data pipelines using PySpark and DatabricksEnsure data quality and manage data life cyclesDevelop ETL processes using PySpark and DatabricksCollaborate with...

  • PySpark with Azure Databricks

    3 weeks ago

    Hyderabad, India HTC Global Services Full time

    Dear Candidate, We have an opportunity of PySpark with DataBricks position with HTC Global Services Please share your updated resume on with below details - We are Looking for Immediate or 15days joiners only Candidate's Full Name (As Per Aadhar) - Total Exp. - Rel. Exp. (in Pyspark) - Rel. Exp. (in Databricks) - Notice Period- If serving...

  • PySpark with Azure Databricks

    1 month ago

    hyderabad, India HTC Global Services Full time

    Dear Candidate,We have an opportunity of PySpark with DataBricks position with HTC Global ServicesPlease share your updated resume on devanshi.nigam@htcinc.com with below details -We are Looking for Immediate or 15days joiners onlyCandidate's Full Name (As Per Aadhar) -Total Exp. -Rel. Exp. (in Pyspark) -Rel. Exp. (in Databricks) -Notice Period-If serving...

  • PySpark with Azure Databricks

    2 days ago

    hyderabad, India HTC Global Services Full time

    Dear Candidate, We have an opportunity of PySpark with DataBricks position with HTC Global Services Please share your updated resume on with below details - We are Looking for Immediate or 15days joiners only Candidate's Full Name (As Per Aadhar) - Total Exp. - Rel. Exp. (in Pyspark) - Rel. Exp. (in Databricks) - Notice Period- If serving Notice or not...

  • PySpark with Azure Databricks

    1 month ago

    Hyderabad, India HTC Global Services Full time

    Dear Candidate,We have an opportunity of PySpark with DataBricks position with HTC Global ServicesPlease share your updated resume on devanshi.nigam@htcinc.com with below details -We are Looking for Immediate or 15days joiners onlyCandidate's Full Name (As Per Aadhar) -Total Exp. -Rel. Exp. (in Pyspark) -Rel. Exp. (in Databricks) -Notice Period-If serving...

  • PySpark with Azure Databricks

    2 weeks ago

    Hyderabad, India HTC Global Services Full time

    Dear Candidate, We have an opportunity of PySpark with DataBricks position with HTC Global Services Please share your updated resume on with below details - We are Looking for Immediate or 15days joiners only Candidate's Full Name (As Per Aadhar) - Total Exp. - Rel. Exp. (in Pyspark) - Rel. Exp. (in Databricks) - Notice Period- If serving...

  • PySpark with Azure Databricks

    2 weeks ago

    hyderabad, India HTC Global Services Full time

    Dear Candidate, We have an opportunity of PySpark with DataBricks position with HTC Global Services Please share your updated resume on with below details - We are Looking for Immediate or 15days joiners only Candidate's Full Name (As Per Aadhar) - Total Exp. - Rel. Exp. (in Pyspark) - Rel. Exp. (in Databricks) - Notice Period- If serving Notice or not...

  • PySpark with Azure Databricks

    1 month ago

    Hyderabad, India HTC Global Services Full time

    Dear Candidate,We have an opportunity of PySpark with DataBricks position with HTC Global ServicesPlease share your updated resume on devanshi.nigam@htcinc.com with below details -We are Looking for Immediate or 15days joiners onlyCandidate's Full Name (As Per Aadhar) -Total Exp. -Rel. Exp. (in Pyspark) -Rel. Exp. (in Databricks) -Notice Period-If serving...