Big Data Architectural Specialist

7 days ago

Shimoga, Karnataka, India beBeeDataEngineer Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

Transform Your Career as a Senior Data Engineer

  • We seek a highly skilled data professional to join our team of consultants.
  • This role involves designing, constructing, and optimizing large-scale data processing systems that enable advanced analytics and business intelligence.

About the Role:

You will collaborate closely with data scientists, analysts, and other engineers to ensure the availability, reliability, and efficiency of our client's Databricks solution.

Key Responsibilities:

  • Design, develop, and maintain scalable and robust data pipelines that collect, process, and store large volumes of structured and unstructured data.
  • Architect and implement data warehouses, data lakes, and other storage solutions that support analytics and reporting needs.
  • Optimize data architectures and workflows for performance, scalability, and cost-efficiency.
  • Collaborate with data scientists and analysts to understand data requirements and ensure that data systems meet their needs.
  • Ensure data quality, integrity, and security by implementing best practices in data governance and management.
  • Develop and maintain documentation for data systems, including data models, flow diagrams, and operational procedures.
  • Mentor and guide junior data engineers, providing technical leadership and support.
  • Stay current with emerging technologies and trends in data engineering, and apply them to improve existing systems.

Requirements:

  • Bachelor's or Master's degree in Computer Science, Information Systems, Engineering, or a related field.
  • 5+ years of experience in data engineering or related fields, with a focus on large-scale data systems.
  • 3+ years of experience with Databricks.
  • Proficiency in SQL and experience with databases such as MySQL, PostgreSQL, or NoSQL databases.
  • Strong programming skills in languages such as Python, Java, or Scala.
  • Experience with ETL tools and frameworks and data pipeline orchestration.
  • Familiarity with big data technologies (e.g., Hadoop, Spark, Kafka) and cloud platforms (AWS, GCP, Azure).
  • Strong understanding of data warehousing concepts, data modeling, and schema design.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication skills and ability to work effectively in a team-oriented environment.

About Us:

We are an equal opportunity employer that recruits and hires qualified candidates without regard to race, religion, sex, sexual orientation, gender identity, age, national origin, ancestry, citizenship, disability, or veteran status.

],

  • Big Data Specialist

    22 hours ago

    Shimoga, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Big Data SpecialistDuration: Full-time OpportunityLocation: Shivamogga, India (Work from office)Key Responsibilities:Design and develop large-scale data processing architectures using SQL, Python, PySpark, and Linux.Implement complex data pipelines and distributed systems to handle high-velocity data streams effectively.Collaborate with...

  • Senior Big Data Specialist

    7 days ago

    Shimoga, Karnataka, India beBeeBigDataSpecialist Full time ₹ 15,00,000 - ₹ 25,00,000

    Job Title: Senior Big Data SpecialistSkill Set:AWS - Amazon Web ServicesPythonPysparkAbout the Role:We are seeking a skilled big data specialist to join our team. The ideal candidate will have hands-on experience with AWS, Python, and Pyspark.Responsibilities:Built pySpark applications using Spark Dataframes in PythonOptimized spark jobs that process huge...

  • Big Data Expert

    16 hours ago

    Shimoga, Karnataka, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    We are currently hiring a Data Specialist to join our team. This role is ideal for professionals with 6-12 years of experience in Big Data technologies.This position requires extensive knowledge of data structures and algorithms.Key Skills We're Looking For:Mastery of Big Data tools including PySpark, Scala Spark, and Java Spark SQL.Experience in building...

  • Cloud Architect

    16 hours ago

    Shimoga, Karnataka, India beBeeBigData Full time ₹ 1,80,00,000 - ₹ 2,50,00,000

    Job OverviewWe are seeking a highly skilled Cloud Architect to lead the design and implementation of our Big Data architecture.This is an exceptional opportunity to work with a talented team and contribute to the development of innovative data management solutions.Key Responsibilities:Design and implement scalable cloud-based architectures for Big Data...

  • Big Data Engineering Solution Specialist

    5 days ago

    Shimoga, Karnataka, India beBeeDataEngineering Full time ₹ 20,00,000 - ₹ 25,00,000

    Job Title: Solution Architect for Big Data EngineeringWe are seeking an experienced Solution Architect to lead the design and implementation of large-scale data engineering solutions. The ideal candidate will have a strong background in Azure Data Engineering, with expertise in Data Factory, Synapse, Fabric, and Databricks. Additionally, they should have...

  • Big Data Innovator

    16 hours ago

    Shimoga, Karnataka, India beBeeData Full time US$ 1,20,000 - US$ 1,60,000

    Your potential unleashed.We present an opportunity to unleash and realise your potential amongst cutting-edge leaders, and organisations shaping the future of the region, and indeed, the world beyond. As a data engineer, you will work with a talented team to drive innovation and solve complex business problems using big data...

  • Big Data Expert

    5 days ago

    Shimoga, Karnataka, India beBeeData Full time ₹ 20,00,000 - ₹ 25,00,000

    **Unlocking Big Data Opportunities:**We are seeking a highly skilled data expert to design and develop innovative solutions that drive business growth.Essential Skills:PySparkHiveDesirable Skills:SparkHBaseData Quality ToolsAgile Methodologies ExperienceExposure in Data Ingestion from Various Sources onto Big Data PlatformsRequirements:A minimum of 6-12...

  • Chief Architect: Big Data Solutions

    4 days ago

    Shimoga, Karnataka, India beBeeEngineering Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Big Data LeaderLead a team of data engineers, working closely with clients and team members to understand their requirements and develop architectures that meet their needs.Key responsibilities include:Building pipelines to bring in various data from multiple sources within the organization and external sources.Collaborating with cross-functional teams to...

  • Big Data Solutions Architect

    16 hours ago

    Shimoga, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,50,00,000

    Job Title: Databricks EngineerWe are seeking an experienced professional to design, develop and maintain scalable, high-performance data solutions using Databricks.The ideal candidate has hands-on experience in Databricks production environments and a deep understanding of modern data architecture. They will work with cross-functional teams to create robust...

  • Data Architectural Specialist

    6 days ago

    Shimoga, Karnataka, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Job Description:As a Senior Data Engineer, you will be responsible for designing and building scalable data architectures on cloud-based platforms.The ideal candidate will have 4+ years of experience in building real-time and batch processing workflows using Azure Databricks, PySpark, and Apache Spark.Design and maintain cloud-based data architectures,...