Data Solution Architect in Spark/Databricks/Snowflake Job at EPAM Systems, Inc., Remote

U0ErWU9OV1JLczZnZWd4WGJ3R1hYeXc5UGc9PQ==
  • EPAM Systems, Inc.
  • Remote

Job Description

Data Solution Architect in Spark/Databricks/Snowflake Description

We are seeking an experienced Data Solution Architect with a strong background in Spark, Databricks, and Snowflake to join our team.

The ideal candidate will design and deploy high-performance, scalable big data architectures and applications. This role involves direct participation in customer workshops, defining network infrastructure solutions, developing roadmaps for data science initiatives, and creating technical documentation to meet our clientele's growing data demands.

#LI-DNI #LI-AP13

Responsibilities

  • Develop proposals for the implementation and design of scalable big data architecture utilizing Spark, Databricks, and Snowflake
  • Participate in customer workshops and present proposed solutions effectively
  • Design, implement, and deploy custom applications at scale on Hadoop and other big data technologies
  • Define network infrastructure solutions for scaling demands and traffic
  • Streamline business and development processes for data acquisition, storage, transformation, and analysis
  • Craft roadmaps and strategies for data science initiatives like prediction models and machine learning
  • Review, audit, and improve existing solutions, designs, and system architectures
  • Offer technical documentation clearly and efficiently
  • Lead technical teams, ensuring adherence to Agile methodologies
  • Conduct performance tuning, optimization, and bottleneck problem analysis

Requirements

  • Minimum of 7 years of practical hands-on experience in software development
  • Knowledge of programming and scripting languages including Python and Scala
  • Experience in designing, developing, or maintaining distributed applications
  • Proficiency in big data technologies such as Hadoop, MapReduce, Apache Spark, Hive, Kafka, Apache Flink, Flume, Cassandra
  • Background in big data solutions within cloud infrastructures such as AWS, Azure Cloud, Google Cloud
  • Experience in managing large-scale client-driven implementation projects
  • Expertise in design patterns, refactoring, unit testing, and CI/CD
  • Skills in applications design, development, and maintenance
  • Competency in performance tuning, optimization, and troubleshooting
  • Qualifications in Object-Oriented Analysis and Design
  • Fluent English communication skills at a B2+ level

Job Tags

Remote job,

Similar Jobs

Bristol Myers Squibb

Sr Manager, Biostatistics Job at Bristol Myers Squibb

 ...with Us**Challenging. Meaningful. Life-changing. Those aren't words that are usually associated with a job. But working at Bristol Myers Squibb is anything but usual. Here, uniquely interesting work happens every day, in every department. From optimizing a production... 

The Hudson School

French Teacher Temporary Part-Time Position Job at The Hudson School

 ...Position: French Teacher Temporary Position Leave Replacement for the Fall Term Division: Middle School (Grades 5-8) Campus: Willow Ave Mission: The Hudson School provides intellectually inquisitive students with a rigorous and relevant college-preparatory education... 

Arvato Bertelsmann

IT Onsite Support Technician Job at Arvato Bertelsmann

 ...corrective steps. Candidate will assist our customers via phone, email, chat & on-site support. Must be meticulous and analytical to...  ...customer issues via phone, email, chat & on-site support Perform remote troubleshooting through diagnostic techniques and pertinent questions... 

Robert Half

Payroll Specialist Job at Robert Half

Description We are offering a short term contract employment opportunity for a Payroll Specialist in Sacramento, California. The role is within the industry, where the candidate will have the opportunity to contribute significantly to our team's operations. Responsibilities... 

Career Personnel

Team Lead - 2nd shift - KAGA Job at Career Personnel

 ...Depends on experience. Hours: 04:00 pm to 01:00 am or until done Monday through Friday. Supervisors report 20-30 minutes before the shift starts and remain for 20-30 minutes after the shift is completed. SUMMARY: Directs the activities of Line Operators involved...