ETL Architect
Company: ApTask
Location: Aurora
Posted on: January 25, 2023
|
|
Job Description:
Role & Responsibilities
Making the basic ETL architectural rules and regulations.
Supervising and guiding ETL architectural implements
Coordinating with the other IT teams to collect design needs and
making specialized structured written papers based on the operative
needs
Assisting the structural and specialized designs of the schemes to
make sure that the judgments are being made in accordance with the
existing and forthcoming business plans of actions and chances
Owning the architectural production actions related to ETL
projects.
Analyze the needs of large systems and breaking them down into
smaller manageable parts
Plan and design the structure of technology systems, discuss these
with the client
Communicate system requirements to software designers and
developers; explain system structure to them and provide assistance
throughout the assembly process.
Choose suitable software, hardware and suggest integration
methods.
Help resolve technical problems as and when they arise
Ensure that systems satisfy quality standards and procedures
What you Must Have
12+ years of IT experience in Data Engineering, Data Quality, Data
Migrations, Data Architecture, Data Lake formation and Data
Analytics.
5+ Years hands on solid Experience on AWS services like S3, EMR,
VPC, EC2, IAM, EBS, RDS, Glue, Lambda, Lake Formation etc.
Must have worked in producing architecture document for small to
large solution implementations.
In depth understanding of Spark Architecture including Spark Code,
Spark SQL, Data frames, Spark Streaming, Spark MLiB, etc.
Experience on handing very high-volume streaming data in various
format like JSON, XML, AVRO, Snappy etc.
Good Exposure to Kafka to design future capacity planning,
partition Planning, Read and write
Must have worked with Big Data and should have good knowledge Mar
reduce and Spark.
Must have very good working exposure on different kind of databases
like RDBMS, No SQL Columnar, Document, distributed databases, Could
Databases, in memory databases etc.
Python Exposure is an added advantage.
Keywords: ApTask, Aurora , ETL Architect, Other , Aurora, Colorado
Click
here to apply!
|