Software Engineer-(AWS Databricks +Mongo DB)

2 weeks ago

Rajkot, India HARP Full time

Job Description

Profile Summary

  • Data Engineer with 5 years of experience in Big Data technologies.
  • Proven expertise in designing and developing scalable data pipelines using Apache Spark and PySpark.
  • Proficient in Python programming.
  • Hands-on experience with Databricks, MongoDB, Docker, and Kubernetes.
  • Solid understanding of DevOps practices and tools.

Primary Skills

  • Design, develop, and maintain scalable and reliable data pipelines.
  • Translate business requirements and data models into efficient ETL code.
  • Work independently on Spark-based data processing workflows.
  • Skilled in writing complex business logic using PySpark and Spark SQL.
  • Strong understanding of Spark clusters, distributed computing, and parallel processing.
  • Capable of writing unit test cases to validate ETL logic.
  • Experience in building reusable functions and applying modular programming approaches.
  • Worked with AWS Athena for table creation, indexing, and writing complex SQL queries.
  • Experience working with both relational databases (e.g., Oracle, SQL Server) and NoSQL databases (e.g., MongoDB) for data extraction and loading.

Secondary Skills

  • Experience in creating AWS IAM roles and defining access policies.
  • Familiar with Docker image creation and customization.
  • Experience with Camunda for workflow orchestration and automation.

Additional Expectations

  • Strong communication skills.
  • Proficient in troubleshooting and problem-solving.
  • Demonstrates a continuous learning mindset.
  • Focused on automating manual tasks through coding wherever feasible.

Technical Skills

Mandatory Skills:

Python for Data, Apache Spark, Java, Python, Scala, Spark SQL, Databricks

  • Databricks SQL Engineer with Commercial Pharma

    3 weeks ago

    Rajkot, India Keasis Full time

    Job Title: Databricks SQL Engineer with Commercial Pharma Location: Remote Type: ContractAbout the Role:We are looking for a Databricks SQL Engineer to design, develop, and optimize data solutions using Databricks SQL. The ideal candidate will have expertise in SQL, performance tuning, data modeling, and cloud-based data platforms such as AWS, Azure, or...

  • Databricks Admin

    3 days ago

    Rajkot, India Tata Consultancy Services Full time

    TCS is Hiring For Databricks AdminJob Location : Chennai, KolkataExperience : 6 - 12 yearsRequired Skillset : Databricks Administration, Terraform, AWS cloud services, MLflow, Workflows, Databricks Asset Bundles, AWS IAM, VPC, private endpoints, firewalls, S3, SQL + PySpark, DBX CLIMust have skills :Databricks Platform Administration including environment...

  • Senior Generative AI Engineer

    3 weeks ago

    Rajkot, India Ampstek Full time

    Title: Senior Generative AI Engineer (Databricks,Data Lake)Location: 100% RemoteJob Type: FulltimeKey Responsibilities• Design and implement GenAI models (LLMs, multimodal, embeddings, and fine-tuning) for enterprise use cases.• Architect and optimize data pipelines and workflows in Databricks for large-scale AI training and inference.• Manage and...

  • Databricks Developer

    2 weeks ago

    Rajkot, India The Best Services & Enterprise's Remote Work Freelance Full time

    job summary:we are seeking an experienced databricks architect to design and implement robust data architecture solutions. the ideal candidate will have deep expertise in databricks unity catalog, mlflow, and databricks ml modules.key responsibilities:design and implement scalable data architecture solutions using databricks.implement and manage databricks...

  • Senior php developer

    2 weeks ago

    Rajkot, India Hala Campus Full time

    Position Overview We are seeking experienced and highly skilled Senior PHP Developers with more than 6 years of experience for our development team at Rajkot, Gujarat. As the Senior PHP Developer, you will be responsible for overseeing the technical design, architecture, and implementation of our web applications using the Laravel and Code Igniter...

  • Senior php developer

    2 weeks ago

    Rajkot, India Hala Campus Full time

    Position Overview We are seeking experienced and highly skilled Senior PHP Developers with more than 6 years of experience for our development team at Rajkot, Gujarat. As the Senior PHP Developer, you will be responsible for overseeing the technical design, architecture, and implementation of our web applications using the Laravel and Code Igniter framework....

  • Senior php developer

    1 week ago

    Rajkot, India Hala Campus Full time

    Position Overview We are seeking experienced and highly skilled Senior PHP Developers with more than 6 years of experience for our development team at Rajkot, Gujarat. As the Senior PHP Developer, you will be responsible for overseeing the technical design, architecture, and implementation of our web applications using the Laravel and Code Igniter framework....

  • Senior Java Software Engineer

    2 weeks ago

    Rajkot, India Recro Full time

    Client is a VC-backed, cloud-native B2B platform transforming how hotels connect with global demand. Founded by serial travel-tech entrepreneurs and backed by Highgate Technology Ventures (HTV), we’re building the next generation of hotel distribution—automated, scalable, and integrated directly with CRS/PMS systems.Scale that speaks for itself: • 1B+...

  • Software developer

    2 days ago

    Rajkot, India Monk Commerce Full time

    We are a fully remote team of 25 people, looking for a new member to join our engineering department. Your primary responsibility will be to design the database schema to efficiently store and retrieve data and to create APIs for business logic that can be utilized by the frontend.We are seeking someone with 2+ years of experience who is well-versed in:Any...

  • Retail domain full stack engineer-java and react to create scalable apis and responsive user interfaces, contributing to real-time data pipelines and cloud-native systems within aws

    1 day ago

    Rajkot, India Artec Solutions Pvt Ltd Full time

    Full Stack Engineer –About the Role:Exp – 3–5 Years relevant experienceFull Stack Engineer with hands-on experience in building modern web applications across both frontend and backend. You’ll work with Java and React to create scalable APIs and responsive user interfaces, contributing to real-time data pipelines and cloud-native systems within AWS....