Pyspark Databricks

3 months ago

Hyderabad, India Risk Resources LLP Full time
OverviewThe positionof Pyspark Databricks is crucial to our organization as it involvesdeveloping and implementing data processing pipelines using Pysparkon the Databricks platform ensuring efficient and scalable dataprocessing and analysis.Keyresponsibilities
  • Design and developdata processing pipelines using Pyspark andDatabricks.
  • Optimize and tune the performanceof Spark jobs and clusters.
  • Implement datatransformations and aggregations for analysis andreporting.
  • Collaborate with data engineers anddata scientists to integrate data from various sources into thepipelines.
  • Develop and maintain ETL processesto extract transform and load data into the datalake.
  • Monitor and troubleshoot data processingjobs to ensure reliability andstability.
  • Conduct code reviews and providetechnical guidance to junior teammembers.
  • Implement best practices for datapipeline development and documentation.
  • Workwith crossfunctional teams to gather and analyze requirements fordata processing.
  • Participate in the evaluationand implementation of new technologies related to big dataprocessing.
Requiredqualifications
  • Bachelors degree inComputer Science Engineering or a relatedfield.
  • Proven experience in developing dataprocessing pipelines using Pyspark andDatabricks.
  • Strong proficiency in Pythonprogramming language.
  • Handson experience withBig Data technologies and distributedcomputing.
  • Expertise in optimizing Spark jobsand clusters for performance.
  • Knowledge of ETLprocesses and data warehousingconcepts.
  • Experience with data integration anddata modeling.
  • Ability to troubleshoot anddebug complex data processing issues.
  • Excellentunderstanding of SQL and NoSQLdatabases.
  • Strong communication andcollaboration skills to work effectively in a teamenvironment.
  • Certifications in PysparkDatabricks or related technologies are aplus.
  • Familiarity with cloud platforms such asAWS Azure or Google Cloud isbeneficial.

python,bigdata,etl,spark,data

  • PySpark with Azure Databricks

    4 weeks ago

    hyderabad, India HTC Global Services Full time

    Dear Candidate, We have an opportunity of PySpark with DataBricks position with HTC Global Services Please share your updated resume on devanshi.nigam@htcinc.com with below details - We are Looking for Immediate or 15days joiners only Candidate's Full Name (As Per Aadhar) - Total Exp. - Rel. Exp. (in Pyspark) - Rel. Exp. (in Databricks) - Notice...

  • Pyspark With Azure Databricks

    4 weeks ago

    hyderabad, India HTC Global Services Full time

    Dear Candidate, We have an opportunity of PySpark with DataBricks position with HTC Global Services Please share your updated resume on devanshi.nigam@htcinc.com with below details - We are Looking for Immediate or 15days joiners only Candidate‘s Full Name (As Per Aadhar) - Total Exp. - Rel. Exp. (in Pyspark) - Rel. Exp. (in Databricks) - Notice...

  • Pyspark With Azure Databricks

    4 weeks ago

    hyderabad, India HTC Global Services Full time

    Dear Candidate, We have an opportunity of PySpark with DataBricks position with HTC Global Services Please share your updated resume on devanshi.nigam@htcinc.com with below details - We are Looking for Immediate or 15days joiners only Candidate‘s Full Name (As Per Aadhar) - Total Exp. - Rel. Exp. (in Pyspark) - Rel. Exp. (in Databricks) - Notice...

  • PySpark with Azure Databricks

    1 month ago

    hyderabad, India HTC Global Services Full time

    Dear Candidate, We have an opportunity of PySpark with DataBricks position with HTC Global Services Please share your updated resume on devanshi.nigam@htcinc.com with below details - We are Looking for Immediate or 15days joiners only Candidate's Full Name (As Per Aadhar) - Total Exp. - Rel. Exp. (in Pyspark) - Rel. Exp. (in Databricks) - Notice Period- If...

  • PySpark with Azure Databricks

    1 month ago

    hyderabad, India HTC Global Services Full time

    Dear Candidate,We have an opportunity of PySpark with DataBricks position with HTC Global ServicesPlease share your updated resume on with below details -We are Looking for Immediate or 15days joiners onlyCandidate's Full Name (As Per Aadhar) -Total Exp. -Rel. Exp. (in Pyspark) -Rel. Exp. (in Databricks) -Notice Period-If serving Notice or not working,...

  • PySpark with Azure Databricks

    1 month ago

    hyderabad, India HTC Global Services Full time

    Dear Candidate,We have an opportunity of PySpark with DataBricks position with HTC Global ServicesPlease share your updated resume on with below details -We are Looking for Immediate or 15days joiners onlyCandidate's Full Name (As Per Aadhar) -Total Exp. -Rel. Exp. (in Pyspark) -Rel. Exp. (in Databricks) -Notice Period-If serving Notice or not working,...

  • PySpark with Azure Databricks

    1 month ago

    Hyderabad, India HTC Global Services Full time

    Dear Candidate,We have an opportunity of PySpark with DataBricks position with HTC Global ServicesPlease share your updated resume on with below details -We are Looking for Immediate or 15days joiners onlyCandidate's Full Name (As Per Aadhar) -Total Exp. -Rel. Exp. (in Pyspark) -Rel. Exp. (in Databricks) -Notice Period-If serving Notice or not working,...

  • PySpark with Azure Databricks

    1 month ago

    hyderabad, India HTC Global Services Full time

    Dear Candidate, We have an opportunity of PySpark with DataBricks position with HTC Global Services Please share your updated resume on with below details - We are Looking for Immediate or 15days joiners only Candidate's Full Name (As Per Aadhar) - Total Exp. - Rel. Exp. (in Pyspark) - Rel. Exp. (in Databricks) - Notice Period- If serving Notice or not...

  • PySpark with Azure Databricks

    2 months ago

    Hyderabad, India HTC Global Services Full time

    Dear Candidate,We have an opportunity of PySpark with DataBricks position with HTC Global ServicesPlease share your updated resume on devanshi.nigam@htcinc.com with below details -We are Looking for Immediate or 15days joiners onlyCandidate's Full Name (As Per Aadhar) -Total Exp. -Rel. Exp. (in Pyspark) -Rel. Exp. (in Databricks) -Notice Period-If serving...

  • PySpark with Azure Databricks

    2 months ago

    Hyderabad, India HTC Global Services Full time

    Dear Candidate, We have an opportunity of PySpark with DataBricks position with HTC Global Services Please share your updated resume on with below details - We are Looking for Immediate or 15days joiners only Candidate's Full Name (As Per Aadhar) - Total Exp. - Rel. Exp. (in Pyspark) - Rel. Exp. (in Databricks) - Notice Period- If serving Notice or not...

  • PySpark with Azure Databricks

    2 months ago

    hyderabad, India HTC Global Services Full time

    Dear Candidate,We have an opportunity of PySpark with DataBricks position with HTC Global ServicesPlease share your updated resume on devanshi.nigam@htcinc.com with below details -We are Looking for Immediate or 15days joiners onlyCandidate's Full Name (As Per Aadhar) -Total Exp. -Rel. Exp. (in Pyspark) -Rel. Exp. (in Databricks) -Notice Period-If serving...

  • PySpark with Azure Databricks

    2 months ago

    Hyderabad, India HTC Global Services Full time

    Dear Candidate,We have an opportunity of PySpark with DataBricks position with HTC Global ServicesPlease share your updated resume on devanshi.nigam@htcinc.com with below details -We are Looking for Immediate or 15days joiners onlyCandidate's Full Name (As Per Aadhar) -Total Exp. -Rel. Exp. (in Pyspark) -Rel. Exp. (in Databricks) -Notice Period-If serving...

  • PySpark with Azure Databricks

    2 months ago

    Hyderabad, India HTC Global Services Full time

    Dear Candidate, We have an opportunity of PySpark with DataBricks position with HTC Global Services Please share your updated resume on with below details - We are Looking for Immediate or 15days joiners only Candidate's Full Name (As Per Aadhar) - Total Exp. - Rel. Exp. (in Pyspark) - Rel. Exp. (in Databricks) - Notice Period- If serving...

  • PySpark with Azure Databricks

    2 months ago

    hyderabad, India HTC Global Services Full time

    Dear Candidate, We have an opportunity of PySpark with DataBricks position with HTC Global Services Please share your updated resume on with below details - We are Looking for Immediate or 15days joiners only Candidate's Full Name (As Per Aadhar) - Total Exp. - Rel. Exp. (in Pyspark) - Rel. Exp. (in Databricks) - Notice Period- If serving Notice or not...

  • PySpark with Azure Databricks

    2 months ago

    Hyderabad, India HTC Global Services Full time

    Dear Candidate, We have an opportunity of PySpark with DataBricks position with HTC Global Services Please share your updated resume on with below details - We are Looking for Immediate or 15days joiners only Candidate's Full Name (As Per Aadhar) - Total Exp. - Rel. Exp. (in Pyspark) - Rel. Exp. (in Databricks) - Notice Period- If serving...

  • Pyspark with azure databricks

    2 months ago

    Hyderabad, India HTC Global Services Full time

    Dear Candidate, We have an opportunity of Py Spark with Data Bricks position with HTC Global Services Please share your updated resume on with below details - We are Looking for Immediate or 15days joiners only Candidate's Full Name (As Per Aadhar) - Total Exp. - Rel. Exp. (in Pyspark) - Rel. Exp. (in Databricks) - Notice Period- If serving Notice...

  • ML Engineer

    6 months ago

    Hyderabad, India Tiger Analytics Full time

    Job Description ML Engineer (Databricks + PySpark) Locations: Chennai / Hyderabad / Bangalore Tiger Analytics is a global leader in AI and analytics, helping Fortune companies solve their toughest challenges. We are on a mission to push the boundaries of what AI and analytics can do to help enterprises navigate uncertainty and move forward decisively....

  • Experienced Data Engineer

    6 days ago

    Hyderabad, Telangana, India HTC Global Services Full time

    We are seeking a highly skilled Data Engineer to join our team at HTC Global Services. This role involves working on exciting projects utilizing PySpark and Azure Databricks.About the RoleAs a Data Engineer, you will be responsible for designing, building, and maintaining large-scale data processing systems. Your expertise in PySpark and Azure Databricks...

  • Databricks Pyspark Consultant with Cloud Expertise

    3 weeks ago

    Hyderabad, Telangana, India Genpact Full time

    At Genpact, we're shaping the future by delivering outcomes that matter. As a global professional services and solutions firm, our 125,000+ people across 30+ countries are driven by our innate curiosity, entrepreneurial agility, and desire to create lasting value for clients.We're inviting applications for the role of Databricks Pyspark Consultant with Cloud...

  • AppSierra Solutions

    3 days ago

    Bangalore/Hyderabad, India AppSierra Solutions Pvt Ltd Full time

    Description :We are seeking a skilled AWS Data Engineer with expertise in Databricks and Pyspark to join our dynamic team. In this crucial role, you will be responsible for designing and implementing big data processing pipelines that efficiently handle and analyze large volumes of data. You will work closely with cross-functional teams to gather...