Big Data Visionary

14 hours ago

Ahmedabad, Gujarat, India beBeeDataArchitect Full time ₹ 20,00,000 - ₹ 30,00,000
Job Title:

Senior Data Architect

Job Description:

We are seeking a skilled Senior Data Architect to lead the design, development and maintenance of large-scale data processing systems. This role requires collaboration with data scientists, analysts and engineers to ensure the availability, reliability and efficiency of our client's Databricks solution.

The ideal candidate will have experience in designing scalable and robust data pipelines that collect, process and store large volumes of structured and unstructured data. They will also have expertise in architecting and implementing data warehouses, data lakes and other storage solutions that support analytics and reporting needs.

Key responsibilities include optimizing data architectures and workflows for performance, scalability and cost-efficiency, collaborating with data scientists and analysts to understand data requirements and ensuring that data systems meet their needs.

Ensuring data quality, integrity and security by implementing best practices in data governance and management is also crucial. The successful candidate will develop and maintain documentation for data systems, including data models, flow diagrams and operational procedures.

Mentorship and guidance of junior data engineers, providing technical leadership and support, is also an essential aspect of this role.

Required Skills and Qualifications:

  • Bachelor's or Master's degree in Computer Science, Information Systems, Engineering or a related field.
  • 5+ years of experience in data engineering or related fields, with a focus on large-scale data systems.
  • 3+ years of experience with Databricks.
  • Proficiency in SQL and experience with databases such as MySQL, PostgreSQL or NoSQL databases.
  • Strong programming skills in languages such as Python, Java or Scala.
  • Experience with ETL tools and frameworks and data pipeline orchestration.
  • Familiarity with big data technologies (e.g., Hadoop, Spark, Kafka) and cloud platforms (AWS, GCP, Azure).
  • Strong understanding of data warehousing concepts, data modeling and schema design.
  • Excellent problem-solving skills and attention to detail.
  • Strong communication skills and ability to work effectively in a team-oriented environment.
Benefits:
  • Opportunity to work with a world-class client.
  • Remote work option.
  • Employment/Contract Type: Contract.
  • Location: India.
  • Duration: 1 year (with potential to be extended).
  • Hours per Week: 40 (Full-time).

  • Big Data

    2 weeks ago

    Ahmedabad, Gujarat, India Tata Consultancy Services Full time

    Greetings from TCSSkill: Big DataYears of Experience: 6 - 12 yearsLocation: Pune/ Mumbai/ ChennaiNotice Period: 0 - 45 daysJob Description:-Must-HavePySparkHiveGood-to-HaveSparkHBaseDQ toolAgile Scrum experienceExposure in data ingestion from disparate sources onto Big Data platform

  • Big Data Professional

    2 weeks ago

    Ahmedabad, Gujarat, India beBeeData Full time ₹ 15,00,000 - ₹ 25,00,000

    Senior Big Data AnalystA senior big data analyst position is available for a highly skilled professional to leverage their knowledge of big data analytics and drive business outcomes. The ideal candidate will have experience working with large datasets, developing and implementing data-driven solutions, and collaborating with cross-functional teams.Key...

  • Big Data Specialist

    7 days ago

    Ahmedabad, Gujarat, India beBeeData Full time ₹ 15,00,000 - ₹ 20,00,000

    Job OverviewWe are seeking a skilled Big Data Specialist to join our team.Responsibilities:Analyze and process large data sets using Big Data technologiesDevelop and implement scalable data pipelinesWork with cross-functional teams to deliver high-quality solutionsRequirements:2+ years of experience in Big Data engineeringStrong skills in Scala, AWS, and...

  • Principal Big Data Engineer

    7 days ago

    Ahmedabad, Gujarat, India beBeeData Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Big Data Specialist RoleAbout the Position:As a key member of our data analytics team, you will be responsible for designing and implementing big data solutions using Scala Spark.Key Responsibilities:Design and implement big data solutions using Scala Spark.Develop and maintain complex data pipelines.Work with large datasets and ensure efficient data...

  • Big Data Specialist

    4 days ago

    Ahmedabad, Gujarat, India beBeeDevelopment Full time ₹ 25,00,000 - ₹ 30,00,000

    About the Job:We are looking for a skilled Big Data Developer to join our team.Job Credentials- Experience: 5 to 12 yearsResponsibilities:Develop and maintain big data applications using Spark, SQL, Hive, and Scala.What We Offer:A competitive salary and benefits package.The opportunity to work with a talented team of professionals.Ongoing training and...

  • Big Data Platform Expert

    3 days ago

    Ahmedabad, Gujarat, India beBeeDataiku Full time ₹ 80,00,000 - ₹ 1,50,00,000

    Expertise in big data platforms is key to driving business innovation and excellence.About the role:Manage a range of big data platform components including Hadoop, Hive, HBase and BigSQL.Support technical and application teams with requests for data copies across environments, data cleanup, query tuning, etc.Troubleshoot and resolve issues related to user...

  • Innovative Big Data Solutions Expert

    5 days ago

    Ahmedabad, Gujarat, India beBeeDataScientist Full time ₹ 1,50,00,000 - ₹ 2,00,00,000

    Big Data Developer PositionAs a key member of our data-driven organization, we are seeking an experienced Big Data Developer to join our team.The ideal candidate will have a proven track record of designing, developing, and implementing big data solutions using cutting-edge technologies such as Spark, Scala, and PySpark. The successful candidate will be...

  • Senior Big Data Architect

    3 days ago

    Ahmedabad, Gujarat, India beBeeDataStrategist Full time ₹ 2,50,00,000 - ₹ 3,50,00,000

    The most impactful opportunity awaits!Job DescriptionWe are seeking an exceptional Big Data Strategist to spearhead the development of our Enterprise TruRisk Platform. This pioneering project aims to empower customers with unparalleled Cyber Risk Management capabilities.This role offers a chance to work closely with a talented team of engineers and...

  • Big Data Developer

    2 days ago

    Ahmedabad, Gujarat, India beBeeDataInfrastructure Full time ₹ 15,00,000 - ₹ 20,00,000

    Data Infrastructure SpecialistWe're looking for an experienced Data Infrastructure Specialist to lead the development and maintenance of our data pipelines. This is a critical role that requires a strong understanding of distributed data systems, cloud platforms, and data warehousing.Key Responsibilities:Design, develop, and manage end-to-end data pipelines...

  • Big Data Developer

    7 days ago

    Ahmedabad, Gujarat, India beBeeData Full time ₹ 18,00,000 - ₹ 24,00,000

    Unlock the Power of Big Data with Us!Job DescriptionWe are seeking a skilled Big Data Hadoop Scala developer to join our team. As a key member, you will be responsible for architecting, developing, and maintaining our big data ecosystem.Key Responsibilities:Hands-on experience in Scala, Spark, Hive, and Hadoop Big Data Eco System Tools is essential.Strong...