Josys - Senior Data Engineer - PySpark/Scala

5 days ago

Bengaluru, India Josys Full time

Location : Bengaluru, Karnataka, India.About The Role : We're looking for an experienced Senior Data Engineer (6-8 years) to join our data team. You'll be key in building and maintaining our data systems on AWS.You'll use your strong skills in big data tools and cloud technology to help our analytics team get valuable insights from our data. You'll be in charge of the whole process of our data pipelines, making sure the data is good, reliable, and fast.What You'll Do- Design and build efficient data pipelines using Spark / PySpark / Scala.- Manage complex data processes with Airflow, creating and fixing any issues with the workflows (DAGs).- Clean, transform, and prepare data for analysis.- Use Python for data tasks, automation, and building tools.- Work with AWS services like S3, Redshift, EMR, Glue, and Athena to manage our data infrastructure.- Collaborate closely with the Analytics team to understand what data they need and provide solutions.- Help develop and maintain our Node.js backend, using Typescript, for data services.- Use YAML to manage the settings for our data tools.- Set up and manage automated deployment processes (CI/CD) using GitHub Actions.- Monitor and fix problems in our data pipelines to keep them running smoothly.- Implement checks to ensure our data is accurate and consistent.- Help design and build data warehouses and data lakes.- Use SQL extensively to query and work with data in different systems.- Work with streaming data using technologies like Kafka for real-time data processing.- Stay updated on the latest data engineering technologies.- Guide and mentor junior data engineers.- Help create data management rules and procedures.What You'll Need- Bachelor's or Master's degree in Computer Science, Engineering, or a related field.- 6-8 years of experience as a Data Engineer.- Strong skills in Spark and Scala for handling large amounts of data.- Good experience with Airflow for managing data workflows and understanding DAGs.- Solid understanding of how to transform and prepare data.- Strong programming skills in Python for data tasks and automation.- Proven experience working with AWS cloud services (S3, Redshift, EMR, Glue, IAM, EC2, and Athena).- Experience building data solutions for Analytics teams.- Familiarity with Node.js for backend development.- Experience with Typescript for backend development is a plus.- Experience using YAML for configuration management.- Hands-on experience with GitHub Actions for automated deployment (CI/CD).- Good understanding of data warehousing concepts.- Strong database skills OLAP/OLTP.- Excellent command of SQL for data querying and manipulation.- Experience with stream processing using Kafka or similar technologies.- Excellent problem-solving, analytical, and communication skills.- Ability to work well independently and as part of a team.Bonus Points :- Familiarity with data lake technologies (e.g., Delta Lake, Apache Iceberg).- Experience with other stream processing technologies (e.g., Flink, Kinesis).- Knowledge of data management, data quality, statistics and data governance frameworks.- Experience with tools for managing infrastructure as code (e.g., Terraform).- Familiarity with container technologies (e.g., Docker, Kubernetes).- Experience with monitoring and logging tools (e.g., Prometheus, Grafana). (ref:hirist.tech)

  • Josys - Senior SecOps Engineer

    20 hours ago

    Bengaluru, India Josys Full time

    Description : Security Operations (SecOps) Engineer.Location : Bangalore.Team : Security & Compliance.Reports to : Engineering Manager Platform & Security.About Josys :Josys is on a mission to redefine enterprise IT operations through automation, visibility, and security.As we continue to scale globally, securing our cloud-native infrastructure and...

  • Senior Data Engineer

    6 days ago

    Bengaluru, India Scaling Theory Technologies Pvt Ltd Full time

    Description :Role Overview :We are seeking an experienced Senior Data Engineer to design, build, and optimize scalable data platforms within the Azure Databricks ecosystem. The ideal candidate will have strong expertise in PySpark/Scala, Delta Lake, and data pipeline architecture, along with experience leading complex data initiatives and mentoring team...

  • Senior Data Engineer

    2 weeks ago

    Bengaluru, India Josys Full time

    Location: Bengaluru, Karnataka, IndiaAbout The RoleWe're looking for an experienced Senior Data Engineer (6-8 years) to join our data team. You'll be key in building and maintaining our data systems on AWS. You'll use your strong skills in big data tools and cloud technology to help our analytics team get valuable insights from our data. You'll be in charge...

  • Senior Data Engineer

    3 weeks ago

    Bengaluru, India Josys Full time

    Location: Bengaluru, Karnataka, India About The Role We're looking for an experienced Senior Data Engineer (6-8 years) to join our data team. You'll be key in building and maintaining our data systems on AWS. You'll use your strong skills in big data tools and cloud technology to help our analytics team get valuable insights from our data. You'll be in...

  • Pyspark with Scala

    1 week ago

    Bengaluru, Karnataka, India Wipro Limited Full time

    **Job Description**: - ** - Job Title: Pyspark with Scala - Req Id: 59596 - City: Bengaluru - State/Province: Karnataka - Posting Start Date: 8/13/25 - Job Description: - Excellent Knowledge on Spark; The professional must have a thorough understanding Spark framework, Performance Tuning etc - Excellent Knowledge and hands-on experience of at least 4+ years...

  • Pyspark with Scala

    1 week ago

    Bengaluru, Karnataka, India Wipro Full time ₹ 6,00,000 - ₹ 18,00,000 per year

    Job DescriptionJob Title: Pyspark with ScalaReq Id: 59596City: BengaluruState/Province: KarnatakaPosting Start Date: 8/13/25Wipro Limited (NYSE: WIT, BSE: 507685, NSE: WIPRO) is a leading technology services and consulting company focused on building innovative solutions that address clients' most complex digital transformation needs. Leveraging our holistic...

  • Senior SecOps Engineer

    4 minutes ago

    Bengaluru, Karnataka, India Josys Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Description : Security Operations (SecOps) Engineer.Location : Bangalore.Team : Security & Compliance.Reports to : Engineering Manager Platform & Security.About Josys : Josys is on a mission to redefine enterprise IT operations through automation, visibility, and security. As we continue to scale globally, securing our cloud-native infrastructure and...

  • Senior Automation Engineer

    1 day ago

    Bengaluru, Karnataka, India Josys Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Senior Automation Engineer - SDET About JOSYS Josys, a dynamic B2B SaaS platform startup, has embarked on a mission to revolutionize IT operations globally, following an exceptional launch in Japan and securing $218 million in Series A and B funding. Our platform enables businesses to conquer the complexities of work-from-anywhere setups, rapid digital...

  • Senior Automation Engineer

    3 days ago

    Bengaluru, Karnataka, India Josys Full time ₹ 12,00,000 - ₹ 24,00,000 per year

    Senior Automation Engineer - SDETAbout JOSYSJosys, a dynamic B2B SaaS platform startup, has embarked on a mission to revolutionize IT operations globally, following an exceptional launch in Japan and securing $218 million in Series A and B funding. Our platform enables businesses to conquer the complexities of work-from-anywhere setups, rapid digital...

  • SecOps Engineer

    18 hours ago

    Bengaluru, India Josys Full time

    Security Operations (SecOps) Engineer Location: Bangalore Team: Security & Compliance Reports to: Engineering Manager – Platform & Security About Josys Josys is on a mission to redefine enterprise IT operations through automation, visibility, and security. As we continue to scale globally, securing our cloud-native infrastructure and application ecosystem...