You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
Copy file name to clipboardExpand all lines: README.md
+33-21Lines changed: 33 additions & 21 deletions
Display the source diff
Display the rich diff
Original file line number
Diff line number
Diff line change
@@ -71,6 +71,7 @@ erDiagram
71
71
```
72
72
73
73
### ER Diagram Description
74
+
The application utilizes a localized SQLite database with a central DiseaseTreatments entity. This table maps unique disease identifiers (corresponding to the model's output index) to detailed diagnostic metadata and prevention strategies.
74
75
75
76
---
76
77
@@ -94,10 +95,21 @@ We chose this PlantVillage Dataset because it's an free access kaggle dataset of
94
95
95
96
## 7. Model Selected
96
97
97
-
### Model Name
98
+
### Model Name
99
+
- Swin Transformer V2 (Classification Backbone)
100
+
- U-Net w/ EfficientNet-B0 (Segmentation Decoder)
101
+
98
102
### Selection Reasoning
103
+
Swin V2 utilizes shifted-window self-attention, construct hierarchically a profound global understanding of the visual space, critical for identifying systemic disease patterns that local convolutions miss.
104
+
U-Net w/ EfficientNet-B0 provides precise spatial localization and high-resolution spatial contouring, critical for accurate pixel-wise severity calculation.
105
+
99
106
### Alternatives Considered
107
+
- MobileNetV3 (Inaccurate on current hardware budget)
108
+
- ConvNeXt (Lower performance on global disease patterns)
109
+
100
110
### Evaluation Metrics
111
+
Classification: Top-1 Accuracy, Macro-F1 Score.
112
+
Segmentation: Mean Intersection over Union (mIoU), Dice Coefficient.
101
113
102
114
---
103
115
@@ -126,34 +138,37 @@ We chose this PlantVillage Dataset because it's an free access kaggle dataset of
126
138
## 10. Module-wise Development & Deliverables
127
139
128
140
### Checkpoint 1: Research & Planning
129
-
- Deliverables:
141
+
- Deliverables: Finalized dataset manifest, training/validation splits, model configurations.
130
142
131
143
### Checkpoint 2: Backend Development
132
-
- Deliverables:
144
+
- Deliverables: Two finalized, serialized, high-accuracy ONNX models: Classification (Swin V2) and Segmentation (U-Net).
133
145
134
146
### Checkpoint 3: Frontend Development
135
-
- Deliverables:
147
+
- Deliverables: Functioning Electron Main Process structure, optimized SQLite database integration via better-sqlite3 with populated treatment data.
136
148
137
149
### Checkpoint 4: Model Training
138
-
- Deliverables:
150
+
- Deliverables: Implementation of the ONNX Inference pipeline within Node.js, blur-detection filter, and pre-inference tensor preprocessing.
- Deliverables: Final cross-platform application installers (e.g., .exe, .dmg, .AppImage)
145
157
146
158
---
147
159
148
160
## 11. End-to-End Workflow
149
161
150
-
1.
151
-
2.
152
-
3.
153
-
4.
154
-
5.
155
-
6.
156
-
7.
162
+
1.Farmer launches the application on a desktop computer.
163
+
2.On the home screen, they are prompted to select their plant type (e.g., Tomato)..
164
+
3.The farmer captures or uploads a leaf photograph.
165
+
4.The backend main process immediately converts the image and runs the blur-detection filter. If the image is blurry, it is immediately rejected, and the user is prompted to retake it..
166
+
5.If passed, the image tensor is routed through the Swin Transformer V2 model for high-accuracy disease identification.
167
+
6.Simultaneously, the image is passed to the U-Net model to create a diseased pixel mask.
168
+
7.The main process averages model predictions (via TTA) for classification stability and calculates the exact severity percentage.
169
+
8.The main process queries the local SQLite database for symptoms, symptoms summary, and control strategies.
170
+
9.The finalized, structured report, combining the diagnosis, severity estimate, and actionable treatment steps, is rendered to the farmer's screen.
171
+
10.The farmer can then save the diagnosis locally or export it as a PDF for future reference.
157
172
158
173
---
159
174
@@ -167,20 +182,17 @@ We chose this PlantVillage Dataset because it's an free access kaggle dataset of
167
182
168
183
## 13. Hackathon Deliverables Summary
169
184
170
-
-
171
-
-
172
-
-
173
-
-
185
+
A fully operational, offline-first desktop application using a sophisticated, cascaded ONNX inference pipeline (Transformer + Segmentation) for agricultural diagnostics.
0 commit comments