Scala Data Architect

5 days ago

Delhi NCRBangaloreHyderabadChennai, India ANLAGE Full time

Are you a seasoned professional with a passion for designing and building scalable data processing systems? Do you have expertise in Scala programming and distributed frameworks like Apache Spark or Kafka? We are seeking an experienced Scala Data Architect to join our team at ANLAGE.

Job Overview:

We are a cutting-edge company that specializes in developing innovative solutions using big data technologies. As a key member of our engineering team, you will play a critical role in shaping the architecture of our data infrastructure. Your primary responsibility will be to design, develop, and maintain large-scale data processing systems that meet the needs of our business stakeholders.

Our ideal candidate will have a strong background in Scala programming, distributed data processing frameworks, and a deep understanding of data architecture and pipelines. You will collaborate closely with data scientists, data analysts, and other engineering teams to optimize the data infrastructure. If you are passionate about building efficient, reliable, and scalable data systems, we encourage you to apply for this exciting opportunity.

Key Responsibilities:
  • Data Pipeline Development: Design, develop, and maintain efficient, reliable, and scalable data pipelines using Scala and distributed frameworks like Apache Spark or Kafka.
  • Data Integration: Integrate data from various sources into data lakes or data warehouses, ensuring high data quality and performance.
  • Performance Optimization: Optimize existing processes and code for performance, scalability, and reliability, especially in distributed environments.
  • Data Architecture: Help define and implement data architecture that supports business analytics, machine learning, and reporting needs.
  • Collaboration: Work closely with data scientists, analysts, and other engineers to translate data requirements into technical solutions.
  • Monitoring & Maintenance: Build tools and processes for monitoring, alerting, and ensuring the reliability of the data infrastructure.
  • Testing & Debugging: Write unit, integration, and end-to-end tests for data pipelines and ensure data integrity across systems.
  • Documentation: Provide clear, concise documentation for both technical and non-technical stakeholders.
Requirements:
  • Experience: 7+ years of experience in data engineering, with a focus on Scala and big data technologies.
  • Programming Languages: Proficient in Scala; experience with Java, Python, or other JVM-based languages is a plus.
  • Big Data Frameworks: Hands-on experience with Apache Spark, Kafka, Hadoop, or similar frameworks.
  • Data Storage Systems: Experience with relational databases (e.g., PostgreSQL, MySQL) and NoSQL databases (e.g., Cassandra, HBase).
  • Data Warehousing: Familiarity with data warehousing solutions like Amazon Redshift, Google BigQuery, or similar.
  • Cloud Platforms: Experience with cloud-based data platforms (AWS, Azure, GCP).
  • Data Processing: Strong understanding of distributed data processing, batch, and streaming data processing techniques.
  • Version Control: Proficiency in using version control systems like Git.
  • Problem-Solving Skills: Strong analytical and problem-solving skills with a focus on continuous improvement.
  • Communication: Excellent communication and teamwork skills, with the ability to translate technical issues into business context.
Preferred Qualifications:
  • Machine Learning: Experience with data pipelines supporting machine learning models.
  • ETL Tools: Familiarity with ETL tools like Apache NiFi, Talend, or Airflow.
  • CI/CD: Experience with continuous integration and deployment pipelines for data pipelines.
  • Microservices: Experience building and managing microservices for data-intensive applications.
  • DevOps: Familiarity with DevOps practices, especially as they apply to data engineering.

The estimated salary for this position is $140,000 - $170,000 per year, depending on location and experience. If you are a motivated and talented individual who is passionate about building scalable data systems, we encourage you to apply for this exciting opportunity.

  • Data Engineer

    1 week ago

    Delhi NCR/Bangalore/Hyderabad/Chennai, India ANLAGE Full time

    Job Overview : We are seeking a highly skilled and motivated Scala Data Engineer to join our team. In this role, you will design, build, and maintain large-scale data processing systems. The ideal candidate will have a strong background in Scala programming, distributed data processing frameworks, and a deep understanding of data architecture and pipelines....

  • Technical Solutions Architect

    2 weeks ago

    Hyderabad, Telangana, India Matrix Global Full time

    Job OverviewWe are seeking a seasoned Scala Developer to join our team as a Technical Solutions Architect. This role will be responsible for designing and delivering technology solutions that meet the needs of our clients.The ideal candidate will have a strong background in big data technologies and experience with Scala, Spark, and HDFS platforms.

  • Data Architect

    6 months ago

    Chennai, India iXceed Solutions Full time

    **Job Title**:Data Architect **Job Location**:WFH from India **Job Mode**: Remote (need to follow Europe Time zone) Primarily experts of **Spark 3.X, SCALA,** Delta lake implementation, streaming solution implementation for IOT in Spark streaming. Kafka expertise. Any experience with MFG BI, DWH and Datalake implementation would be a bonus. **Job Type**:...

  • Senior Data Architect

    1 week ago

    Hyderabad, Telangana, India SID Information Technologies Full time

    Job DescriptionSID Information Technologies is seeking a highly skilled Senior Data Architect to join our team. In this role, you will be responsible for designing and building a cohesive foundational platform that drives intelligence and business reports.Key Responsibilities:Designing and developing complex data engineering pipelines using Apache Spark and...

  • Data Engineer III

    2 days ago

    Bangalore, India Freelance Full time

    Job Description : Key Responsibilities :- Develop, construct, test, and maintain data architectures (e.g., databases, large-scale processing systems)- Build high-quality data pipelines using Spark/Scala- Implement best software engineering practices, including Git version control, code reviews, and unit testing- Collaborate with data scientists and...

  • Data Architect

    1 month ago

    Delhi NCR/Bangalore/Hyderabad/Chennai, India ANLAGE Full time

    Data Engineer Position at ANLAGEWe are seeking a highly skilled Data Engineer to design, build, and maintain large-scale data processing systems. In this role, you will work closely with data scientists, data analysts, and other engineering teams to optimize the data infrastructure.Main Responsibilities:Data Pipeline Development: Design, develop, and...

  • Wipro - Senior Data Engineer - Python/Scala

    2 weeks ago

    Bangalore/Hyderabad/Chennai/Pune, India Wipro Ltd Full time

    Job Description : In this role, you will : - Design & Develop batch and streaming solutions using various Big Data technologies - Work closely with architect to design secure and scalable - Be responsible for assessing technologies and approaches for ingestion, transformation and storage - Develop software utilizing open-source technologies to...

  • Scala Data Engineer

    10 hours ago

    Delhi, India Essvee Consultant Full time

    Profile : Scala Data Engineer / Sr. Data Engineer | Location: Mumbai | Experience: 5 or 5+ years | Budget : 10 to 15lac | Hybrid Job |Note: If you want your CV shortlisted, Copy, Paste and fill out the below form for a better response.Scala Data Engineer / Sr. Data EngineerSkills:Spark, Data Bricks, Azure, Azure Data, SQL, Services, Databricks, Data...

  • Data Engineer

    2 days ago

    Noida/Bangalore/Chennai/Hyderabad/Coimbatore, India Huntsmen & Barons Full time

    Role : Data Engineer - Apache spark/Spark/Scala/pysparkJob Description :- Relevant Experience 5 years.- The indent is created for Apache spark. But the actual demand is for Spark/ Scala.- Expertise in Data Engineering.- Hands-on experience in design and development of big data platform.- Deep understanding of modern data processing technology stacks: Spark,...

  • Scala Data Engineer

    3 weeks ago

    Delhi, India Essvee Consultant Full time

    Profile : Scala Data Engineer / Sr. Data Engineer | Location: Mumbai | Experience: 5 or 5+ years | Budget : 10 to 15lac | Hybrid Job |Note: If you want your CV shortlisted, Copy, Paste and fill out the below form for a better response.Data Engineer / Sr. Data EngineerSkills: Spark, Data Bricks, Azure, Azure Data, SQL, Services, Databricks, Data Migration,...

  • Data Architect

    1 month ago

    Hyderabad, Telangana, India NTT DATA Business Solutions Full time

    A Data Architect at NTT DATA Business Solutions plays a pivotal role in designing, building, and managing the infrastructure and tools that enable efficient processing and analysis of large data sets.Key Responsibilities:Designing and Implementing ETL Processes:Develop scalable data pipelines and create efficient Extract, Transform, Load (ETL)...

  • Data Architect

    1 month ago

    Bangalore, India The Metromax Group Full time

    Job SummaryAt The Metromax Group, we are seeking a skilled Data Architect to design and develop data pipelines using AWS Glue, EMR, Spark Scala, and S3 to support both batch and real-time data processing needs. This role will involve implementing ETL processes to extract, transform, and load data from various sources (structured and unstructured) into the...

  • Big Data Developer

    1 month ago

    Hyderabad/Bangalore/Chennai/Bhubaneshwar, India Rigel networks Full time

    Job Title : Big Data/Spark Scala DeveloperLocation : Type : Full-TimeJob Overview : We are looking for an experienced Big Data/Spark Scala Developer to join our team. The ideal candidate will have a deep understanding of big data technologies and strong programming skills in Scala. In this role, you will be responsible for designing, developing, and...

  • Data Engineer

    2 months ago

    Chennai, India Huntsmen & Barons Full time

    Role : Data Engineer - Apache spark/Spark/Scala/pysparkJob Description :- Relevant Experience 5 years.- The indent is created for Apache spark. But the actual demand is for Spark/ Scala.- Expertise in Data Engineering.- Hands-on experience in design and development of big data platform.- Deep understanding of modern data processing technology stacks: Spark,...

  • Crayon Data

    3 weeks ago

    Chennai, India Crayon Data India Pvt. Ltd Full time

    About the job :Role : Sr Data ScientistExperience level : 5 to 8 yearsLocation : ChennaiWho are we?Crayon Data is a leading provider of AI-led revenue acceleration solutions, headquartered in Singapore with a local presence in India and the UAE. The company was founded in 2012 with the vision of simplifying the world's choices. Our flagship platform,...

  • Senior Data Architect

    2 weeks ago

    Hyderabad, Telangana, India SID Information Technologies Full time

    SID Information Technologies is seeking a highly skilled Senior Platform Engineer/Senior Data Engineer to join our team. The ideal candidate will have 5+ years of experience developing production software in Java, Scala, or Python and expertise in building custom ETL pipelines with a focus on design, data modeling, implementation, and maintenance.The role...

  • Data Systems Architect

    3 weeks ago

    Chennai, Tamil Nadu, India Colan Infotech Private Limited Full time

    Colan Infotech Private Limited seeks a highly skilled Data Systems Architect to lead the design, development and maintenance of scalable data pipelines. The ideal candidate should have 4-8 years of experience in the field and be proficient in programming languages such as Python, SQL and Pyspark/Scala Spark.The successful candidate will work closely with...

  • Data Engineering Architect

    2 days ago

    Hyderabad, Telangana, India SID Information Technologies Full time

    Job Title: Data Engineering ArchitectAbout the Role:We are seeking an experienced Data Engineering Architect to join our team at SID Information Technologies. The successful candidate will be responsible for designing and implementing scalable, efficient, and secure data pipelines using Apache Spark, Kafka Streams, and AWS services.Responsibilities:Design...

  • Scala Big Data Solutions Developer

    2 weeks ago

    Chennai, Tamil Nadu, India Truetech Full time

    We are seeking a skilled Scala Big Data Solutions Developer to join our team at Truetech in Chennai. As a seasoned expert, you will be responsible for designing and implementing large-scale data processing systems using Scala, Apache Spark, and GCP services.The ideal candidate will have 6-8 years of experience in working with Scala, Java, and Apache Spark....

  • Data Engineering Lead

    3 months ago

    Hyderabad, India upGrad Full time

    Job Title : Data Engineering Lead. Location : Hyderabad. Experience : 6-8 Years. Company Overview : UpGrad is a leader in the online education space, providing high-quality learning experiences to individuals and businesses worldwide. We are looking for a Data Engineering Lead to drive the development of data solutions that will shape the future of our data...