forked from Edu-MLOps-BA1125/Training_Documents
-
Notifications
You must be signed in to change notification settings - Fork 0
Expand file tree
/
Copy pathClass_Notes.txt
More file actions
415 lines (225 loc) · 7.29 KB
/
Class_Notes.txt
File metadata and controls
415 lines (225 loc) · 7.29 KB
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
MLOps: Edu
Start Date: 29th Nov. 2025
8:30PM-11:30PM IST - SAT-SUN
####################
Day1: 29th Nov. 2025
####################
- MLOps Introduction :::
Github Account :
https://github.com/
- What is DevOps ???
SDLC : Software Development Life Cycle :
- Requirement Analysis
- Designg & Document
- Code & Development
- Testing
- Implement to Prod
- Monitor/Maintain
- Waterfall:
- It is Linear in fashion.
- It strictly follows Top-Down Approach
- Requirement Analysis
- Designg & Document
- Code & Development
- Testing
- Implement to Prod
- Monitor/Maintain
Software Applications :
- Desktop Applications
- Web Applications
- Mobile Applications
- Embedded Applications
- Desktop Applications :::
SuperMarket Billing System:
--> Functions/Modules
- User Interface Design
- Inventory Mgmt
- Billing Mgmt
- Supplier Mgmt
- Payment Mgmt
- Cash Payment
- Card Payment
- Online Payment
- UPI Payment
Core Project :
- Requirement Analysis --> 12 Months
- Designg & Document
- Code & Development --> 6th Month
- Testing
- Implement to Prod
- Monitor/Maintain
Enhancement Project :
- Requirement Analysis
- Designg & Document
- Code & Development
- Testing
- Implement to Prod
- Monitor/Maintain
AGILE Methodologies :::
- Desktop Applications :::
SuperMarket Billing System:
--> Functions/Modules --> iterations
- User Interface Design
- Inventory Mgmt
- Billing Mgmt
- Supplier Mgmt
- Payment Mgmt
- Cash Payment
- Card Payment
- Online Payment
- UPI Payment
Iteration 1 : User Interface Design
- Requirement Analysis
- Designg & Document
- Code & Development
- Testing
- Implement to Prod with proper manual approvals
- Monitor/Maintain
Iteration 2 : Inventory Mgmt
- Requirement Analysis
- Designg & Document
- Code & Development
- Testing
- Implement to Prod with proper manual approvals
- Monitor/Maintain
nth Iteration : Online Payment
- Requirement Analysis
- Designg & Document
- Code & Development
- Testing
- Implement to Prod with proper manual approvals
- Monitor/Maintain
Using AGILE Methodologies:
- We can Achieve :
- Continuous Development
- Continuous Integration
- Continuous Testing
- Continuous Delivery
- Used to perform Production release with manual approvals.
- We cannot Achieve :
- Continuous Deployment
- Used to perform Production release without any manual approvals.
- What is DevOps ???
- DevOps :::::
DevOps is a Software Development Strategy, which helps to promote the collaboration between the teams like Development Team and Operations Team to achieve Continuous Development, Continuous Integration, Continuous Testing, Continuous Delivery, Continuous Deployment and Continuous Monitoring in more Automated Fashion.
Continuous Delivery & Deployment:
- Both Continuous Delivery & Continuous Deployment are used to release the changes from Non-Prod to Prod.
Continuous Delivery:
- Continuous Delivery Exepects Manual Approvals
- We might experience the Application Down-time
Eg:
Banking Domain :
Online Banking / Credit Card Transaction
Create a Production Release Window:
4 - 6Hrs
Continuous Deployment:
- Never Exepects Manual Approvals
- Deploy the changes to production without any down-time.
Eg:
- Amazon/Netflix/Facebook/Google ::
- How to Implement DevOps :::
- Identify the Teams involved in the process of SDLC :
- DevOps Team
- Infra-Structure Management Team
- Application Development Team
- Testing Team
- Release Management Team
- Production Support Team
- Production Monitoring Team
- IT Security
- Environments :
Non-Prod Prod Environments
Dev Environment
Test Environment
QA
UAT ================> Production Servers - 1,2,3,4,5
- Application Architecture :
- Monolith Application Architecture:
- It Tightly-Coupled Application Architecture
- All the dependencies are tightly coupled
- With the we can achieve only Continuous Delivery.
- We cannot achieve Continuous Deployment
- Micro-Service Based Application Architecture:
- It is Loose-Coupled Application Architecture,
- Each and every function is considered as Micro-Service.
- With this we can achieve Continuous Deployment.
Devops :::
- People
- Strategy/Process
- Tools
####################
Day2: 30th Nov. 2025
####################
MLOps Lifecycle :
MLOps Usecase :
Versioning :
Version Control System using Git :
Git Demo :
ML Project and Packaging ML Model
CICD Pipeline:
- SCM_Checkout ==> VCS ?
- Application Build
- Create Application Artifacts
- Test
- Deploy
How to Implement MLOps :::
- Data Engineers -> Prepare the Source Datasets
- Data Scientists -> Explore the datasets, analyse, check the feasibility of datasets
Perform the training, tuning, and evaluate the Model
- ML Engineers -> Deploy the ML Models to prod -> MLOps Strageies CICD, define best practises
Should have MLOps Knowledge
- Business Stakeholders -> Bring business values using this ML Models
- Data Security/Governance Team --> To Ensure data security & Governance, data privacy
ML Model Use Case :
ML Model for Product Reviews :
E_Commerce Application Eg. www.amazon.com
Product Review:
CICD Pipeline:
- SCM_Checkout ==> VCS ?
- Application Build
- Create Application Artifacts
- Test
- Deploy
Process/Lifecycle of Machine Learning Ops:::
- Data Preparation
- Exploratory Data Analysis (EDA)
- Feature Engineering
- Model Training
- Model Validations
- Model Deployment
- Monitoring
MLOps Use cases:
- Healthcare
- Finance
- Retail Domain - E_Commerce
- Manufacturing
How to Implement MLOps :::
- Vesioning:
Version Control System :
- To Version Control the Changes
- To Track the Changes
Types of VCS :
- Centralized VCS:
- Distributed VCS:
GIT :
- Git is an Open-Source Distributed VCS
- To Version Control the Changes
- To Track the Changes
- To perform Parallel Development using Branching Techniques
Lab Requirements:
- Create GitHub Account
- https://github.com/
- Install Git Client on Local Machine
- Windows OS :
- Git Bash
- Git CMD
- Git GUI
- Linux/Mac OS :
- Terminal
Git - Client install on Local Machine
Github - Remote Repository Server
Next :::
- Create AWS Free Tier Account
- Create DockerHub Account
- Install Visual Studio Code on Local Machine
- Install Python on Local Machine