2796 Engineering courses delivered Online

A course by Sekhar Metla IT Industry Expert RequirementsNo programming experience needed. You will learn everything you need to knowNo software is required in advance of the course (all software used in the course is free)No pre-knowledge is required - you will learn from basic Audience Beginner JavaScript, Python and MSSQL developers curious about data science development Anyone who wants to generate new income streams Anyone who wants to build websites Anyone who wants to become financially independent Anyone who wants to start their own business or become freelance Anyone who wants to become a Full stack web developer AUDIENCE * Beginner JavaScript, Python and MSSQL developers curious about data science development * Anyone who wants to generate new income streams * Anyone who wants to build websites * Anyone who wants to become financially independent * Anyone who wants to start their own business or become freelance * Anyone who wants to become a Full stack web developer

While CAD design comes with civil drawing, it gets even more significant for the design and construction industry. This course brings the combination of the CAD Design and Civil Drawing that makes your design more practical and vibrant. Learn how to master jaw-dropping design with this course. Start learning CAD Design Course: Assemblies, Modelling and Civil Drawings that will give you enough knowledge and skills to build your dream career. ABOUT THIS COURSE This CAD Design Course: Assemblies, Modelling and Civil Drawings helps to grow your skills faster through the power of relevant content and world-class tutors. In this industry-leading bite-sized course, you will learn up-to-date knowledge in the relevant field within a few hours and get certified immediately. The modules of this course are very easy to understand and all of the topics are split into different sections. You will easily grasp and use the knowledge gained from this course in your career and go one step ahead of your competitors. The course is designed to improve your employability and provide you with the tools you need to succeed. Enrol today and start learning your essential skills. WHY CHOOSE THIS COURSE * Earn a digital Certificate upon successful completion. * Accessible, informative modules taught by expert instructors * Study in your own time, at your own pace, through your computer tablet or mobile device * Get 24/7 help or advice from our email and live chat teams * Get full tutor support on weekdays (Monday to Friday) COURSE DESIGN The CAD Design Course: Assemblies, Modelling and Civil Drawings is delivered through our online learning platform, accessible through any internet-connected device. There are no formal deadlines or teaching schedules, meaning you are free to study the course at your own pace. You are taught through a combination of * Video lessons * Online study materials WHO IS THIS COURSE FOR:€‹ This CAD Design Course: Assemblies, Modelling and Civil Drawings is ideal for those who want to be skilled in this field or who wish to learn a new skill to build their dream career. If you want to gain extensive knowledge, potential experience, and be an expert in the related field then this is a great course for you to grow your career. REQUIREMENTS * This course is for anyone who would like to learn CAD Design Course: Assemblies, Modelling and Civil Drawings related skills to aid his/her career path. * No formal entry prerequisites are required CERTIFICATION Upon successful completion of the course, you will be able to obtain your course completion e-certificate. Print copy by post is also available at an additional cost of £9.99 and PDF Certificate at £4.99. COURSE CONTENT * Module 01: Introduction to Geometry and Modelling * Module 02: CAD Design Assemblies * Module 03: Introduction to Extrusion and Rotations * Module 04: CAD Blending Operations * Module 05: Civil Drawing Parameters COURSE CONTENT CAD: CAD Design and Civil Drawing Module 01: Introduction to Geometry and Modelling 00:20:00 Module 02: CAD Design Assemblies 00:19:00 Module 03: Introduction to Extrusion and Rotations 00:19:00 Module 04: CAD Blending Operations 00:30:00 Module 05: Civil Drawing Parameters 00:22:00 Order your Certificates & Transcripts Order your Certificates & Transcripts 00:00:00 FREQUENTLY ASKED QUESTIONS Are there any prerequisites for taking the course? There are no specific prerequisites for this course, nor are there any formal entry requirements. All you need is an internet connection, a good understanding of English and a passion for learning for this course. Can I access the course at any time, or is there a set schedule? You have the flexibility to access the course at any time that suits your schedule. Our courses are self-paced, allowing you to study at your own pace and convenience. How long will I have access to the course? For this course, you will have access to the course materials for 1 year only. This means you can review the content as often as you like within the year, even after you've completed the course. However, if you buy Lifetime Access for the course, you will be able to access the course for a lifetime. Is there a certificate of completion provided after completing the course? Yes, upon successfully completing the course, you will receive a certificate of completion. This certificate can be a valuable addition to your professional portfolio and can be shared on your various social networks. Can I switch courses or get a refund if I'm not satisfied with the course? We want you to have a positive learning experience. If you're not satisfied with the course, you can request a course transfer or refund within 14 days of the initial purchase. How do I track my progress in the course? Our platform provides tracking tools and progress indicators for each course. You can monitor your progress, completed lessons, and assessments through your learner dashboard for the course. What if I have technical issues or difficulties with the course? If you encounter technical issues or content-related difficulties with the course, our support team is available to assist you. You can reach out to them for prompt resolution.

Learning how to ride a bicycle is an utterly practical knowledge. However, theoretical knowledge can make you more practical in dealing with a bicycle. This course has been designed keeping eyes on the steering system, toolbox and understanding the bike. Start learning Bicycle Training that will give you enough knowledge and skills to build your dream career. ABOUT THIS COURSE This Bicycle Training helps to grow your skills faster through the power of relevant content and world-class tutors. In this industry-leading bite-sized course, you will learn up-to-date knowledge in the relevant field within a few hours and get certified immediately. The modules of this course are very easy to understand and all of the topics are split into different sections. You will easily grasp and use the knowledge gained from this course in your career and go one step ahead of your competitors. The course is designed to improve your employability and provide you with the tools you need to succeed. Enrol today and start learning your essential skills. WHY CHOOSE THIS COURSE * Earn a digital Certificate upon successful completion. * Accessible, informative modules taught by expert instructors * Study in your own time, at your own pace, through your computer tablet or mobile device * Get 24/7 help or advice from our email and live chat teams * Get full tutor support on weekdays (Monday to Friday) COURSE DESIGN The Bicycle Training is delivered through our online learning platform, accessible through any internet-connected device. There are no formal deadlines or teaching schedules, meaning you are free to study the course at your own pace. You are taught through a combination of * Video lessons * Online study materials WHO IS THIS COURSE FOR:€‹ This Bicycle Training is ideal for those who want to be skilled in this field or who wish to learn a new skill to build their dream career. If you want to gain extensive knowledge, potential experience, and be an expert in the related field then this is a great course for you to grow your career. REQUIREMENTS * This course is for anyone who would like to learn Bicycle Training related skills to aid his/her career path. * No formal entry prerequisites are required CERTIFICATION Upon successful completion of the course, you will be able to obtain your course completion e-certificate. Print copy by post is also available at an additional cost of £9.99 and PDF Certificate at £4.99. COURSE CONTENT * Module 1: Understand Your Bike * Module 2: Tools You Should Have in Your Toolbox * Module 3: Introduction to The Steering System * Module 4: Introduction to The Gears COURSE CONTENT Bicycle Training Course for Beginners Understand Your Bike 00:07:00 Tools You Should Have in Your Toolbox 00:13:00 Introduction to The Steering System 00:07:00 Introduction to The Gears 00:10:00 Order your Certificates & Transcripts Order your Certificates & Transcripts 00:00:00 FREQUENTLY ASKED QUESTIONS Are there any prerequisites for taking the course? There are no specific prerequisites for this course, nor are there any formal entry requirements. All you need is an internet connection, a good understanding of English and a passion for learning for this course. Can I access the course at any time, or is there a set schedule? You have the flexibility to access the course at any time that suits your schedule. Our courses are self-paced, allowing you to study at your own pace and convenience. How long will I have access to the course? For this course, you will have access to the course materials for 1 year only. This means you can review the content as often as you like within the year, even after you've completed the course. However, if you buy Lifetime Access for the course, you will be able to access the course for a lifetime. Is there a certificate of completion provided after completing the course? Yes, upon successfully completing the course, you will receive a certificate of completion. This certificate can be a valuable addition to your professional portfolio and can be shared on your various social networks. Can I switch courses or get a refund if I'm not satisfied with the course? We want you to have a positive learning experience. If you're not satisfied with the course, you can request a course transfer or refund within 14 days of the initial purchase. How do I track my progress in the course? Our platform provides tracking tools and progress indicators for each course. You can monitor your progress, completed lessons, and assessments through your learner dashboard for the course. What if I have technical issues or difficulties with the course? If you encounter technical issues or content-related difficulties with the course, our support team is available to assist you. You can reach out to them for prompt resolution.

This course has been designed to give you a comprehensive skillset for carpentry, building materials & concrete construction industry. It includes an overview of building materials, concrete construction, and a checklist of tools. Hit this bite-sized course to learn all carpentry hacks. Start learning Carpentry Training: Building Materials & Concrete Construction that will give you enough knowledge and skills to build your dream career. ABOUT THIS COURSE This Carpentry Training: Building Materials & Concrete Construction helps to grow your skills faster through the power of relevant content and world-class tutors. In this industry-leading bite-sized course, you will learn up-to-date knowledge in the relevant field within a few hours and get certified immediately. The modules of this course are very easy to understand and all of the topics are split into different sections. You will easily grasp and use the knowledge gained from this course in your career and go one step ahead of your competitors. The course is designed to improve your employability and provide you with the tools you need to succeed. Enrol today and start learning your essential skills. WHY CHOOSE THIS COURSE * Earn a digital Certificate upon successful completion. * Accessible, informative modules taught by expert instructors * Study in your own time, at your own pace, through your computer tablet or mobile device * Get 24/7 help or advice from our email and live chat teams * Get full tutor support on weekdays (Monday to Friday) COURSE DESIGN The Carpentry Training: Building Materials & Concrete Construction is delivered through our online learning platform, accessible through any internet-connected device. There are no formal deadlines or teaching schedules, meaning you are free to study the course at your own pace. You are taught through a combination of * Video lessons * Online study materials WHO IS THIS COURSE FOR:€‹ This Carpentry Training: Building Materials & Concrete Construction is ideal for those who want to be skilled in this field or who wish to learn a new skill to build their dream career. If you want to gain extensive knowledge, potential experience, and be an expert in the related field then this is a great course for you to grow your career. REQUIREMENTS * This course is for anyone who would like to learn Carpentry Training: Building Materials & Concrete Construction related skills to aid his/her career path. * No formal entry prerequisites are required CERTIFICATION Upon successful completion of the course, you will be able to obtain your course completion e-certificate. Print copy by post is also available at an additional cost of £9.99 and PDF Certificate at £4.99. COURSE CONTENT * Module 1: An Overview of Carpentry * Module 2: Use and Checklist for Tools * Module 3: An Overview of Building Materials * Module 4: An Overview of Concrete Construction * Module 5: An Overview of Stair Construction COURSE CONTENT Building Materials & Concrete Construction Module 1: An Overview of Carpentry 00:09:00 Module 2: Use and Checklist for Tools 00:12:00 Module 3: An Overview of Building Materials 00:09:00 Module 4: An Overview of Concrete Construction 00:11:00 Module 5: An Overview of Stair Construction 00:07:00 Order your Certificates & Transcripts Order your Certificates & Transcripts 00:00:00 FREQUENTLY ASKED QUESTIONS Are there any prerequisites for taking the course? There are no specific prerequisites for this course, nor are there any formal entry requirements. All you need is an internet connection, a good understanding of English and a passion for learning for this course. Can I access the course at any time, or is there a set schedule? You have the flexibility to access the course at any time that suits your schedule. Our courses are self-paced, allowing you to study at your own pace and convenience. How long will I have access to the course? For this course, you will have access to the course materials for 1 year only. This means you can review the content as often as you like within the year, even after you've completed the course. However, if you buy Lifetime Access for the course, you will be able to access the course for a lifetime. Is there a certificate of completion provided after completing the course? Yes, upon successfully completing the course, you will receive a certificate of completion. This certificate can be a valuable addition to your professional portfolio and can be shared on your various social networks. Can I switch courses or get a refund if I'm not satisfied with the course? We want you to have a positive learning experience. If you're not satisfied with the course, you can request a course transfer or refund within 14 days of the initial purchase. How do I track my progress in the course? Our platform provides tracking tools and progress indicators for each course. You can monitor your progress, completed lessons, and assessments through your learner dashboard for the course. What if I have technical issues or difficulties with the course? If you encounter technical issues or content-related difficulties with the course, our support team is available to assist you. You can reach out to them for prompt resolution.

Duration 4 Days 24 CPD hours This course is intended for Project administrators and ETL developers responsible for data extraction and transformation using DataStage. Overview Describe the uses of DataStage and the DataStage workflowDescribe the Information Server architecture and how DataStage fits within itDescribe the Information Server and DataStage deployment optionsUse the Information Server Web Console and the DataStage Administrator client to create DataStage users and to configure the DataStage environmentImport and export DataStage objects to a fileImport table definitions for sequential files and relational tablesDesign, compile, run, and monitor DataStage parallel jobsDesign jobs that read and write to sequential filesDescribe the DataStage parallel processing architectureDesign jobs that combine data using joins and lookupsDesign jobs that sort and aggregate dataImplement complex business logic using the DataStage Transformer stageDebug DataStage jobs using the DataStage PX Debugger This course enables the project administrators & developers to acquire the skills necessary to develop parallel jobs in DataStage. Students will learn to create parallel jobs that access sequential & relational data, and combine and transform the data. COURSE OUTLINE * Introduction to DataStage * Deployment * DataStage Administration * Work with Metadata * Create Parallel Jobs * Access Sequential Data * Partitioning and Collecting Algorithms * Combine Data * Group Processing Stages * Transformer Stage * Repository Functions * Work with Relational Data * Control Jobs

Duration 2 Days 12 CPD hours This course is intended for People working in an organization aiming to improve performance, especially in response to digital transformation or disruption. Any roles involved in the creation and delivery of products or services: Leadership and CXO, especially CIO, CTO, CPO, and CVO Transformation and evolution leads and change agents Value stream architects, managers, engineers Scrum Masters, agile and DevOps coaches and facilitators Portfolio, product and project managers, and owners Business analysts Architects, developers, and engineers Release and environment managers IT Ops, service and support desk workers Customer experience and success professionals Overview After completing this course, students will be able to: Describe the origins of value stream management and key concepts such as flow, value, and delivery Describe what value stream management is, why it's needed and the business benefits of its practice Describe how lean, agile, DevOps, and ITSM principles contribute to value stream management Identify and describe value streams, where they start and end, and how they interconnect Identify value stream roles and responsibilities Express value streams visually using mapping techniques, define current and target states and hypothesis backlog Write value stream flow and realization optimization hypotheses and experiments Apply metrics such as touch/processing time, wait/idle time, and cycle time to value streams Understand flow metrics and how to access the data to support data-driven conversations and decisions Examine value realization metrics and aligning to business outcomes, and how to sense and respond to them (outcomes versus outputs) Architect a DevOps toolchain alongside a value stream and data connection points Design a continuous inspection and adaptation approach for organizational evolution The Value Stream Management Foundation course from Value Stream Management Consortium, and offered in partnership with DevOps Institute, is an introductory course taking learners through a value stream management implementation journey. It considers the human, process, and technology aspects of this way of working and explores how optimizing value streams for flow and realization positively impacts organizational performance. HISTORY AND EVOLUTION OF VALUE STREAM MANAGEMENT AND ITS APPLICATION * Value stream management?s origins * Definitions of value stream management * Flow * Lean and systems thinking and practices * Agile, DevOps and other frameworks * Research and analysis IDENTIFYING VALUE STREAMS * What is a value stream? * Identifying value streams * Choosing a value stream * Digital value streams * Value stream thinking MAPPING VALUE STREAMS * Types of maps * Value stream mapping * The fuzzy front end * Artifacts * 10 steps to value stream mapping * Mapping and management * VSM investment case * Limitations of value stream mapping CONNECTING DEVOPS TOOLCHAINS * CICD and the DevOps toolchain * Value stream management processes * Value stream management platforms * DevOps tool categories * Building an end-to-end DevOps toolchain * Common data model and tools integrations VALUE STREAM METRICS * The duality of VSM * Downtime in technology * Lean, DORA and Flow metrics * Definition of Done * Value metrics * Benefits hypotheses * Value streams as profit centers * KPIs and OKRs INSPECTING THE VALUE STREAM * 3 Pillars of Empiricism * Organizational performance * Visibility * When to inspect * Data and discovery * Insights and trends ORGANIZING AS VALUE STREAMS * Value stream alignment * Team types and topologies * Project to product * Hierarchy to autonomy * Target Operating Model * Value stream people * Value stream roles * Value stream funding EVOLVING VALUE STREAMS * Why now? * Transitions * VSM capability matrix * VSM culture iceberg * Learning * Making local discoveries global improvements * Managing value stream interdependencies

Duration 4 Days 24 CPD hours This course is intended for The workshop is designed for data scientists who currently use Python or R to work with smaller datasets on a single machine and who need to scale up their analyses and machine learning models to large datasets on distributed clusters. Data engineers and developers with some knowledge of data science and machine learning may also find this workshop useful. Overview Overview of data science and machine learning at scale Overview of the Hadoop ecosystem Working with HDFS data and Hive tables using Hue Introduction to Cloudera Data Science Workbench Overview of Apache Spark 2 Reading and writing data Inspecting data quality Cleansing and transforming data Summarizing and grouping data Combining, splitting, and reshaping data Exploring data Configuring, monitoring, and troubleshooting Spark applications Overview of machine learning in Spark MLlib Extracting, transforming, and selecting features Building and evaluating regression models Building and evaluating classification models Building and evaluating clustering models Cross-validating models and tuning hyperparameters Building machine learning pipelines Deploying machine learning models Spark, Spark SQL, and Spark MLlib PySpark and sparklyr Cloudera Data Science Workbench (CDSW) Hue This workshop covers data science and machine learning workflows at scale using Apache Spark 2 and other key components of the Hadoop ecosystem. The workshop emphasizes the use of data science and machine learning methods to address real-world business challenges. Using scenarios and datasets from a fictional technology company, students discover insights to support critical business decisions and develop data products to transform the business. The material is presented through a sequence of brief lectures, interactive demonstrations, extensive hands-on exercises, and discussions. The Apache Spark demonstrations and exercises are conducted in Python (with PySpark) and R (with sparklyr) using the Cloudera Data Science Workbench (CDSW) environment. The workshop is designed for data scientists who currently use Python or R to work with smaller datasets on a single machine and who need to scale up their analyses and machine learning models to large datasets on distributed clusters. Data engineers and developers with some knowledge of data science and machine learning may also find this workshop useful. OVERVIEW OF DATA SCIENCE AND MACHINE LEARNING AT SCALE OVERVIEW OF THE HADOOP ECOSYSTEM WORKING WITH HDFS DATA AND HIVE TABLES USING HUE INTRODUCTION TO CLOUDERA DATA SCIENCE WORKBENCH OVERVIEW OF APACHE SPARK 2 READING AND WRITING DATA INSPECTING DATA QUALITY CLEANSING AND TRANSFORMING DATA SUMMARIZING AND GROUPING DATA COMBINING, SPLITTING, AND RESHAPING DATA EXPLORING DATA CONFIGURING, MONITORING, AND TROUBLESHOOTING SPARK APPLICATIONS OVERVIEW OF MACHINE LEARNING IN SPARK MLLIB EXTRACTING, TRANSFORMING, AND SELECTING FEATURES BUILDING AND EVAUATING REGRESSION MODELS BUILDING AND EVALUATING CLASSIFICATION MODELS BUILDING AND EVALUATING CLUSTERING MODELS CROSS-VALIDATING MODELS AND TUNING HYPERPARAMETERS BUILDING MACHINE LEARNING PIPELINES DEPLOYING MACHINE LEARNING MODELS ADDITIONAL COURSE DETAILS: Nexus Humans Cloudera Data Scientist Training training program is a workshop that presents an invigorating mix of sessions, lessons, and masterclasses meticulously crafted to propel your learning expedition forward. This immersive bootcamp-style experience boasts interactive lectures, hands-on labs, and collaborative hackathons, all strategically designed to fortify fundamental concepts. Guided by seasoned coaches, each session offers priceless insights and practical skills crucial for honing your expertise. Whether you're stepping into the realm of professional skills or a seasoned professional, this comprehensive course ensures you're equipped with the knowledge and prowess necessary for success. While we feel this is the best course for the Cloudera Data Scientist Training course and one of our Top 10 we encourage you to read the course outline to make sure it is the right content for you. Additionally, private sessions, closed classes or dedicated events are available both live online and at our training centres in Dublin and London, as well as at your offices anywhere in the UK, Ireland or across EMEA.

Duration 2 Days 12 CPD hours This course is intended for Experienced DataStage developers seeking training in more advanced DataStage job techniques and who seek techniques for working with complex types of data resources. Overview Use Connector stages to read from and write to database tables Handle SQL errors in Connector stages Use Connector stages with multiple input links Use the File Connector stage to access Hadoop HDFS data Optimize jobs that write to database tables Use the Unstructured Data stage to extract data from Excel spreadsheets Use the Data Masking stage to mask sensitive data processed within a DataStage job Use the Hierarchical stage to parse, compose, and transform XML data Use the Schema Library Manager to import and manage XML schemas Use the Data Rules stage to validate fields of data within a DataStage job Create custom data rules for validating data Design a job that processes a star schema data warehouse with Type 1 and Type 2 slowly changing dimensions This course is designed to introduce you to advanced parallel job data processing techniques in DataStage v11.5. In this course you will develop data techniques for processing different types of complex data resources including relational data, unstructured data (Excel spreadsheets), and XML data. In addition, you will learn advanced techniques for processing data, including techniques for masking data and techniques for validating data using data rules. Finally, you will learn techniques for updating data in a star schema data warehouse using the DataStage SCD (Slowly Changing Dimensions) stage. Even if you are not working with all of these specific types of data, you will benefit from this course by learning advanced DataStage job design techniques, techniques that go beyond those utilized in the DataStage Essentials course. ACCESSING DATABASES * Connector stage overview * - Use Connector stages to read from and write to relational tables * - Working with the Connector stage properties * Connector stage functionality * - Before / After SQL * - Sparse lookups * - Optimize insert/update performance * Error handling in Connector stages * - Reject links * - Reject conditions * Multiple input links * - Designing jobs using Connector stages with multiple input links * - Ordering records across multiple input links * File Connector stage * - Read and write data to Hadoop file systems * Demonstration 1: Handling database errors * Demonstration 2: Parallel jobs with multiple Connector input links * Demonstration 3: Using the File Connector stage to read and write HDFS files PROCESSING UNSTRUCTURED DATA * Using the Unstructured Data stage in DataStage jobs * - Extract data from an Excel spreadsheet * - Specify a data range for data extraction in an Unstructured Data stage * - Specify document properties for data extraction. * Demonstration 1: Processing unstructured data DATA MASKING * Using the Data Masking stage in DataStage jobs * - Data masking techniques * - Data masking policies * - Applying policies for masquerading context-aware data types * - Applying policies for masquerading generic data types * - Repeatable replacement * - Using reference tables * - Creating custom reference tables * Demonstration 1: Data masking USING DATA RULES * Introduction to data rules * - Using the Data Rules Editor * - Selecting data rules * - Binding data rule variables * - Output link constraints * - Adding statistics and attributes to the output information * Use the Data Rules stage to valid foreign key references in source data * Create custom data rules * Demonstration 1: Using data rules PROCESSING XML DATA * Introduction to the Hierarchical stage * - Hierarchical stage Assembly editor * - Use the Schema Library Manager to import and manage XML schemas * Composing XML data * - Using the HJoin step to create parent-child relationships between input lists * - Using the Composer step * Writing Hierarchical data to a relational table * Using the Regroup step * Consuming XML data * - Using the XML Parser step * - Propagating columns * Topic 6: Transforming XML data * - Using the Aggregate step * - Using the Sort step * - Using the Switch step * - Using the H-Pivot step * Demonstration 1: Importing XML schemas * Demonstration 2: Compose hierarchical data * Demonstration 3: Consume hierarchical data * Demonstration 4: Transform hierarchical data UPDATING A STAR SCHEMA DATABASE * Surrogate keys * - Design a job that creates and updates a surrogate key source key file from a dimension table * Slowly Changing Dimensions (SCD) stage * - Star schema databases * - SCD stage Fast Path pages * - Specifying purpose codes * - Dimension update specification * - Design a job that processes a star schema database with Type 1 and Type 2 slowly changing dimensions * Demonstration 1: Build a parallel job that updates a star schema database with two dimensions ADDITIONAL COURSE DETAILS: Nexus Humans KM423 IBM InfoSphere DataStage v11.5 - Advanced Data Processing training program is a workshop that presents an invigorating mix of sessions, lessons, and masterclasses meticulously crafted to propel your learning expedition forward. This immersive bootcamp-style experience boasts interactive lectures, hands-on labs, and collaborative hackathons, all strategically designed to fortify fundamental concepts. Guided by seasoned coaches, each session offers priceless insights and practical skills crucial for honing your expertise. Whether you're stepping into the realm of professional skills or a seasoned professional, this comprehensive course ensures you're equipped with the knowledge and prowess necessary for success. While we feel this is the best course for the KM423 IBM InfoSphere DataStage v11.5 - Advanced Data Processing course and one of our Top 10 we encourage you to read the course outline to make sure it is the right content for you. Additionally, private sessions, closed classes or dedicated events are available both live online and at our training centres in Dublin and London, as well as at your offices anywhere in the UK, Ireland or across EMEA.

Duration 5 Days 30 CPD hours This course is intended for This intermediate and beyond level course is geared for experienced technical professionals in various roles, such as developers, data analysts, data engineers, software engineers, and machine learning engineers who want to leverage Scala and Spark to tackle complex data challenges and develop scalable, high-performance applications across diverse domains. Practical programming experience is required to participate in the hands-on labs. Overview Working in a hands-on learning environment led by our expert instructor you'll: Develop a basic understanding of Scala and Apache Spark fundamentals, enabling you to confidently create scalable and high-performance applications. Learn how to process large datasets efficiently, helping you handle complex data challenges and make data-driven decisions. Gain hands-on experience with real-time data streaming, allowing you to manage and analyze data as it flows into your applications. Acquire practical knowledge of machine learning algorithms using Spark MLlib, empowering you to create intelligent applications and uncover hidden insights. Master graph processing with GraphX, enabling you to analyze and visualize complex relationships in your data. Discover generative AI technologies using GPT with Spark and Scala, opening up new possibilities for automating content generation and enhancing data analysis. Embark on a journey to master the world of big data with our immersive course on Scala and Spark! Mastering Scala with Apache Spark for the Modern Data Enterprise is a five day hands on course designed to provide you with the essential skills and tools to tackle complex data projects using Scala programming language and Apache Spark, a high-performance data processing engine. Mastering these technologies will enable you to perform a wide range of tasks, from data wrangling and analytics to machine learning and artificial intelligence, across various industries and applications.Guided by our expert instructor, you?ll explore the fundamentals of Scala programming and Apache Spark while gaining valuable hands-on experience with Spark programming, RDDs, DataFrames, Spark SQL, and data sources. You?ll also explore Spark Streaming, performance optimization techniques, and the integration of popular external libraries, tools, and cloud platforms like AWS, Azure, and GCP. Machine learning enthusiasts will delve into Spark MLlib, covering basics of machine learning algorithms, data preparation, feature extraction, and various techniques such as regression, classification, clustering, and recommendation systems. INTRODUCTION TO SCALA * Brief history and motivation * Differences between Scala and Java * Basic Scala syntax and constructs * Scala's functional programming features INTRODUCTION TO APACHE SPARK * Overview and history * Spark components and architecture * Spark ecosystem * Comparing Spark with other big data frameworks BASICS OF SPARK PROGRAMMING SPARKCONTEXT AND SPARKSESSION * Resilient Distributed Datasets (RDDs) * Transformations and Actions * Working with DataFrames SPARK SQL AND DATA SOURCES * Spark SQL library and its advantages * Structured and semi-structured data sources * Reading and writing data in various formats (CSV, JSON, Parquet, Avro, etc.) * Data manipulation using SQL queries BASIC RDD OPERATIONS * Creating and manipulating RDDs * Common transformations and actions on RDDs * Working with key-value data BASIC DATAFRAME AND DATASET OPERATIONS * Creating and manipulating DataFrames and Datasets * Column operations and functions * Filtering, sorting, and aggregating data INTRODUCTION TO SPARK STREAMING * Overview of Spark Streaming * Discretized Stream (DStream) operations * Windowed operations and stateful processing PERFORMANCE OPTIMIZATION BASICS * Best practices for efficient Spark code * Broadcast variables and accumulators * Monitoring Spark applications INTEGRATING EXTERNAL LIBRARIES AND TOOLS, SPARK STREAMING * Using popular external libraries, such as Hadoop and HBase * Integrating with cloud platforms: AWS, Azure, GCP * Connecting to data storage systems: HDFS, S3, Cassandra, etc. INTRODUCTION TO MACHINE LEARNING BASICS * Overview of machine learning * Supervised and unsupervised learning * Common algorithms and use cases INTRODUCTION TO SPARK MLLIB * Overview of Spark MLlib * MLlib's algorithms and utilities * Data preparation and feature extraction LINEAR REGRESSION AND CLASSIFICATION * Linear regression algorithm * Logistic regression for classification * Model evaluation and performance metrics CLUSTERING ALGORITHMS * Overview of clustering algorithms * K-means clustering * Model evaluation and performance metrics COLLABORATIVE FILTERING AND RECOMMENDATION SYSTEMS * Overview of recommendation systems * Collaborative filtering techniques * Implementing recommendations with Spark MLlib INTRODUCTION TO GRAPH PROCESSING * Overview of graph processing * Use cases and applications of graph processing * Graph representations and operations * Introduction to Spark GraphX * Overview of GraphX * Creating and transforming graphs * Graph algorithms in GraphX BIG DATA INNOVATION! USING GPT AND GENERATIVE AI TECHNOLOGIES WITH SPARK AND SCALA * Overview of generative AI technologies * Integrating GPT with Spark and Scala * Practical applications and use cases Bonus Topics / Time Permitting INTRODUCTION TO SPARK NLP * Overview of Spark NLP Preprocessing text data * Text classification and sentiment analysis PUTTING IT ALL TOGETHER * Work on a capstone project that integrates multiple aspects of the course, including data processing, machine learning, graph processing, and generative AI technologies.

Duration 4 Days 24 CPD hours This course is intended for This course is best suited to developers, engineers, and architects who want to use use Hadoop and related tools to solve real-world problems. Overview Skills learned in this course include:Creating a data set with Kite SDKDeveloping custom Flume components for data ingestionManaging a multi-stage workflow with OozieAnalyzing data with CrunchWriting user-defined functions for Hive and ImpalaWriting user-defined functions for Hive and ImpalaIndexing data with Cloudera Search Cloudera University?s four-day course for designing and building Big Data applications prepares you to analyze and solve real-world problems using Apache Hadoop and associated tools in the enterprise data hub (EDH). INTRODUCTION APPLICATION ARCHITECTURE * Scenario Explanation * Understanding the Development Environment * Identifying and Collecting Input Data * Selecting Tools for Data Processing and Analysis * Presenting Results to the Use DEFINING & USING DATASETS * Metadata Management * What is Apache Avro? * Avro Schemas * Avro Schema Evolution * Selecting a File Format * Performance Considerations USING THE KITE SDK DATA MODULE * What is the Kite SDK? * Fundamental Data Module Concepts * Creating New Data Sets Using the Kite SDK * Loading, Accessing, and Deleting a Data Set IMPORTING RELATIONAL DATA WITH APACHE SQOOP * What is Apache Sqoop? * Basic Imports * Limiting Results * Improving Sqoop?s Performance * Sqoop 2 CAPTURING DATA WITH APACHE FLUME * What is Apache Flume? * Basic Flume Architecture * Flume Sources * Flume Sinks * Flume Configuration * Logging Application Events to Hadoop DEVELOPING CUSTOM FLUME COMPONENTS * Flume Data Flow and Common Extension Points * Custom Flume Sources * Developing a Flume Pollable Source * Developing a Flume Event-Driven Source * Custom Flume Interceptors * Developing a Header-Modifying Flume Interceptor * Developing a Filtering Flume Interceptor * Writing Avro Objects with a Custom Flume Interceptor MANAGING WORKFLOWS WITH APACHE OOZIE * The Need for Workflow Management * What is Apache Oozie? * Defining an Oozie Workflow * Validation, Packaging, and Deployment * Running and Tracking Workflows Using the CLI * Hue UI for Oozie PROCESSING DATA PIPELINES WITH APACHE CRUNCH * What is Apache Crunch? * Understanding the Crunch Pipeline * Comparing Crunch to Java MapReduce * Working with Crunch Projects * Reading and Writing Data in Crunch * Data Collection API Functions * Utility Classes in the Crunch API WORKING WITH TABLES IN APACHE HIVE * What is Apache Hive? * Accessing Hive * Basic Query Syntax * Creating and Populating Hive Tables * How Hive Reads Data * Using the RegexSerDe in Hive DEVELOPING USER-DEFINED FUNCTIONS * What are User-Defined Functions? * Implementing a User-Defined Function * Deploying Custom Libraries in Hive * Registering a User-Defined Function in Hive EXECUTING INTERACTIVE QUERIES WITH IMPALA * What is Impala? * Comparing Hive to Impala * Running Queries in Impala * Support for User-Defined Functions * Data and Metadata Management UNDERSTANDING CLOUDERA SEARCH * What is Cloudera Search? * Search Architecture * Supported Document Formats INDEXING DATA WITH CLOUDERA SEARCH * Collection and Schema Management * Morphlines * Indexing Data in Batch Mode * Indexing Data in Near Real Time PRESENTING RESULTS TO USERS * Solr Query Syntax * Building a Search UI with Hue * Accessing Impala through JDBC * Powering a Custom Web Application with Impala and Search