Optimize Large-Scale Data Architectures

3 days ago

Jaipur, Rajasthan, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000
Job Title: Senior Data Engineer

Job Description:

Our organization is seeking an experienced Senior Data Engineer to design, build, and maintain large-scale data pipelines and architectures.

The ideal candidate will have hands-on experience with big data tools such as HDFS, Spark, Hive, HBase, Kafka, Kinesis, and relational SQL and NoSQL databases like Elasticsearch and Cassandra/Mongodb.

Experience with cloud services like AWS/GCP is also required. The successful candidate will work closely with cross-functional teams to design and implement optimal data pipeline architecture, create events/streaming based architecture/design, and identify process improvements to automate manual processes and optimize data delivery.

Responsibilities:

  • Create and maintain optimal data pipeline architecture
  • Create and maintain events/streaming based architecture/design
  • Identify, design, and implement internal process improvements: automating manual processes, optimizing data delivery, re-designing infrastructure for greater scalability, etc.
  • Build the infrastructure required for optimal extraction, transformation, and loading of data from a wide variety of data sources using SQL and 'big data' technologies.
  • Create data tools for analytics and data scientist team members that assist them in building and optimizing our product into an innovative industry leader.
  • Work with data scientists to strive for greater functionality in our data systems.

Requirements:

  • Proficiency in either Scala or Python, expertise in Spark, and experience with performance tuning and optimization.
  • DBT is mandatory.
  • Experience with big data tools: HDFS/S3, Spark/Flink, Hive, HBase, Kafka/Kinesis, etc.
  • Experience with relational SQL and NoSQL databases, including Elasticsearch and Cassandra/Mongodb.
  • Experience with data pipeline and workflow management tools: Azkaban, Luigi, Airflow, etc.
  • Experience with AWS/GCP cloud services.
  • Experience with stream-processing systems: Spark-Streaming/Flink, etc.
  • Experience with object-oriented/object function scripting languages: Java, Scala, etc.
  • Strong analytic skills related to working with structured/unstructured datasets.
  • Build processes supporting data transformation, data structures, dimensional modeling, metadata, dependency, schema registration/evolution and workload management.
  • Working knowledge of message queuing, stream processing, and highly scalable 'big data' data stores.
  • Experience supporting and working with cross-functional teams in a dynamic environment.

  • Data Architect for Large Scale Analytics

    4 days ago

    Jaipur, Rajasthan, India beBeeAnalytical Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Analytics Data EngineerOverview: We are seeking an experienced Snowflake data engineer with a strong background in data warehousing concepts and analytical workloads. The successful candidate will have hands-on experience with Snowflake query writing, optimization, and architecture.Key Responsibilities:Design and develop advanced SQL queries for large-scale...

  • Data Specialist

    6 days ago

    Jaipur, Rajasthan, India beBeeSoftwareEngineer Full time ₹ 1,80,00,000 - ₹ 2,40,00,000

    About the RoleThis is an opportunity to join a dynamic team as a Software Engineer specializing in data processing for LLM development.Data engineering plays a crucial role in successful model training and evaluation. You will work closely with researchers to accelerate experiments, develop new datasets, improve infrastructure efficiency, and enable key...

  • Building Large-Scale Enterprise Data Solutions

    2 weeks ago

    Jaipur, Rajasthan, India beBeeData Full time ₹ 12,50,000 - ₹ 17,50,000

    Enterprise Data Solutions ArchitectA key member of our team will be responsible for architecting and implementing data solutions that support analytics, business intelligence, and AI/ML use cases.Key Responsibilities:Design, implement, and maintain large-scale data platforms, including Data Lakes, Data Warehouses/Lakehouses, and Data Marts to support diverse...

  • Senior Design Professional

    4 days ago

    Jaipur, Rajasthan, India beBeeArchitect Full time ₹ 12,00,000 - ₹ 24,00,000

    Our Mumbai studio seeks an Architect II to work on large-scale, integrated design projects across sectors.This role offers the opportunity to collaborate with global design teams and specialist consultants.The ideal candidate will be a design-sensitive, technically strong architect with excellent Revit (BIM) skills and the ability to manage documentation and...

  • Data Architectural Specialist

    6 days ago

    Jaipur, Rajasthan, India beBeeDataEngineer Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Opportunity: Data Architectural SpecialistExperience Required: 3-5 years of experience in data processing and engineering.Notice Period: Immediate start available for the right candidate.Work Mode: Hybrid work environment, balancing office and remote work.Key Responsibilities:The ideal candidate will have strong skills in large-scale data processing and...

  • Strategic Marketing Leader

    2 weeks ago

    Jaipur, Rajasthan, India beBeePerformance Full time ₹ 12,00,000 - ₹ 15,00,000

    Job Title: High-Budget Campaign ManagerWe are seeking a seasoned marketing expert to lead the strategy, planning, and execution of large-scale PPC and Paid Social campaigns across international markets.This role involves developing scalable paid media strategies to drive business growth, managing significant advertising budgets, conducting in-depth data...

  • Automate Large-Scale Web Applications

    2 weeks ago

    Jaipur, Rajasthan, India beBeeAutomation Full time ₹ 15,00,000 - ₹ 20,00,000

    Automation SpecialistWe are seeking skilled Automation Specialists to automate large-scale web applications.This role involves utilizing expertise in TestComplete and JavaScript to create efficient test cases for unit tests (15,000–16,000) and end-to-end tests (5,000–6,000).Main Responsibilities:Design and execute comprehensive automation strategies...

  • Chief Architectural Data Strategist

    4 days ago

    Jaipur, Rajasthan, India beBeeData Full time ₹ 1,68,96,000 - ₹ 2,01,12,000

    Lead Data Engineer Job DescriptionWe are seeking a skilled Lead Data Engineer to drive the development and improvement of our data practice.The successful candidate will have strong expertise in SQL, big data processing, and modern data platforms. They will design, build, and optimize data pipelines for large-scale structured and unstructured datasets,...

  • Principal Engineer for Large-Scale Distributed Applications

    4 days ago

    Jaipur, Rajasthan, India beBeeSoftware Full time ₹ 1,80,00,000 - ₹ 2,00,00,000

    Job OverviewWe are seeking a seasoned software engineer with 10+ years of experience to design and develop large-scale distributed applications that meet scalability, reliability, and performance requirements.The ideal candidate will have expertise in Spring, Hibernate, and RESTful API services, as well as strong Java skills.A strong background in NoSQL...

  • Frontend Architecture Specialist

    1 week ago

    Jaipur, Rajasthan, India beBeeFrontend Full time ₹ 20,00,000 - ₹ 30,00,000

    About The PositionWe are seeking a visionary Frontend Architect to lead the Angular frontend ecosystem for complex, large-scale applications.Key ResponsibilitiesDesign and oversee frontend systems using Angular and TypeScript for large-scale SPAs and web apps.Promote and evolve frontend architectural patterns: feature-based modularization, lazy-loaded...