Starkflow
Hi
Greetings from Starkflow ! We are looking for a Big Data Engineer with GCP.
Duration – Initial engagement for 2 month, with potential for extension based on performance and project requirements.
Job Description
We are looking for a skilled and experienced Big Data Engineer to join our dynamic team. The ideal
candidates will have at least 3-5 years of experience in big data engineering, with specific expertise in
Google Cloud Platform (GCP) technologies, including BigQuery, Cloud Composer, Cloud Functions, Cloud
DataFlow, and Cloud DataProc. You will be responsible for designing, implementing, and optimizing our
data processing and analysis infrastructure.
What you will do at Prism as a Big Data Engineer:
Design and Implementation: Develop and implement scalable data pipelines using GCP services.
Data Management: Utilize BigQuery for data warehousing and complex SQL querying.
Workflow Automation: Implement and manage workflows using Cloud Composer.
Serverless Functions: Develop and deploy serverless functions using Cloud Functions.
Data Processing: Design and execute data processing jobs using Cloud DataFlow and Cloud DataProc.
Optimization: Optimize performance and cost-efficiency of data processing and storage solutions.
Work closely with data scientists, analysts, and other engineers to ensure data solutions meet
business requirements.
Create and maintain technical documentation for data pipelines and processes.
Required Qualifications:
Min of 3-5 years of experience as a Big Data Engineer or in a similar role, with a focus on GCP
technologies.
In-depth knowledge of BigQuery, including SQL query optimization and data modeling.
Hands-on experience with Cloud Composer (Apache Airflow) for orchestration and automation
of workflows.
Proficiency in developing and deploying serverless functions using Cloud Functions.
Expertise in using Cloud DataFlow for batch and stream processing.
Experience with Cloud DataProc for running Apache Hadoop and Spark jobs.
Strong programming skills in Python, Java, or Scala.
Solid understanding of data architecture principles and best practices.
Strong analytical and problem-solving skills.
Excellent verbal and written communication skills.
Powered by JazzHR
Starkflow
You must sign in to apply for this position.
