Index of Lessons in Technology

Toggle All Sections

Algorithms: Analysis And Design

From Codility

Course Link: By James Cutajar

1. Binary Gap (Problem of Iterations)
2. Arrays
   • 2.1: Cyclic rotation (Problem of Arrays)
   • 2.2: Odd occurrences in an array
3. Time Complexity
   • Frog Jump (Level: Easy)
   • Perm Missing Element
   • Tape Equilibrium
     Minimize the value |(A[0] + ... + A[P-1]) - (A[P] + ... + A[N-1])|
4. Counting Elements
   • Swap The Elements (A problem on counting elements)
   • Frog River One (A problem of counting elements)
   • Perm Check (A problem of counting elements)
   • Max Counters (a problem on counting elements)
   • Missing Integer: Find the smallest positive integer that does not occur in a given sequence.
5. Prefix Sums
   • Mushroom Picker (A problem on Prefix Sums)
   • Passing Cars (Count the number of passing cars on the road)
   • Div Count (Problem on Prefix Sums)
   • Genomic Range Query: Find the minimal nucleotide from a range of sequence DNA (Medium Complexity)
   • Min Avg Two Slice: Find the minimal average of any slice containing at least two elements. (Complexity: Medium)
6. Sorting
   • Count distinct elements in an array (Complexity: Easy)
   • MaxProductOfThree
     Maximize A[P] * A[Q] * A[R] for any triplet (P, Q, R).
     Complexity: Easy
   • Triangle formation from three sides (Complexity: Easy)
   • Number of disc intersections (Problem in sorting and searching)
7. Stacks and Queues
   • Brackets (A problem related to Stacks)
   • Voracious Fish (A problem on the concept of Stacks)
   • Manhattan stonewall problem on the concept of Stacks
8. Leader using Boyer-Moore Majority Vote Algo
   • Dominator (a problem on the concept of Leader in Algorithms using Boyer-Moore Majority Vote Algo)
   • EquiLeader (A problem in the concept of Leader in DSA)
9. Maximum Slice Problem (using Kadane's Algo leveraging Dynamic Programming)
   • The Original Maximum Slice Problem
10. Recursion (An Introduction)
    • Permutations of a set of alphabets using JavaScript
    • Combinations of a set of alphabets using JavaScript
    • Bubble Sort (Using Recursion)
    • Building a Tree from a BODMAS Expression
11. Substring in another string (Lesson in Algorithms)

Anaconda

1. Anaconda Setup on Ubuntu for the First Time
2. Installing a new Kernel in Jupyter Notebook (Anaconda) on Windows for Python 2.7
3. Installing a new kernel in Jupyter Notebook in Anaconda with Python 3.8.3 on Ubuntu 20.04
4. Setting up Conda environment for a project
5. Creating and removing an environment in Anaconda Prompt (anaconda3)
6. Setting up Conda Environment for Swagger and Scrapy based project
7. Integration of Anaconda and PowerBI Desktop
8. Installing RASA using YML File in Anaconda [Tags: Python, Natural Language Processing]
9. % Issues in RASA CLI installation in Conda Env using YML file (and workarounds) [Tags: Python, Natural Language Processing]
   % With Less Logs
10. Compare pip and conda installations [Tags: 'Anaconda', 'Python Package Installation and Environment Management']
11. Set up Conda Environment For Google's Generative AI package

Android Development

A1: Flutter Use Cases

1. Setting up Ubuntu 20.04 for Flutter based Android app development (Sep 2020)
2. Failing to launch Android Virtual Device on Ubuntu in VirtualBox on Windows 10 [Tags: Flutter, VirtualBox]
3. Hello World Program Using Dart 2
4. Flutter Demo App For Android - Counter
5. Simple Flutter Android App That Receives Firebase Push Notification

A2: Flutter Notes

1. Setting up Windows 10 for Android development using Flutter, Firebase database and Firebase Cloud Messaging [Tags: Databases, Flutter]
2. Flutter for Android App Development Notes (Dec 2019)
3. Flutter for Android App Development Notes (Week 2, Sep 2020)
4. Flutter for Android Development (Notes on installation, Oct 2020)

A3: React Native

1. Getting Started With React Native

A4: Termux

1. Termux to get information about my Android device
2. Using Git commands on Android Phone [Tags: Android, GitHub]

Artificial Intelligence

1. Career Road Map for Artificial Intelligence & Data Science [20210725]
2. What will it take for AI to become mainstream in business (ML Evolution)
3. Why Coding is Important
4. Definitions of 'Artificial Intelligence'
5. AI and the disciplines it borrows ideas from
6. Talk on Artificial Intelligence with Computer Science and Engg. Students (Dec 2023)

Cloud

C1: Heroku

1. Activating MFA on Heroku (May 2021) [Tags: Cloud, Cyber Security]
2. Deploying Flask based 'Hello World' REST API on Heroku Cloud [Tags: Cloud, Flask]
3. Heroku Dashboard And Settings
4. Flask CORS based API hosted on Heroku [Tags: Heroku, Flask]

C2: Google

1. Set up Google OAuth 2.0 Authentication For Blogger and Retrieve Blog Posts via Blogger API (v3) [Tags: Cloud, Python, Web Development]
2. Polymorphism in Google Drive and Google Chrome (wrt Handling an Exe File) [Tags: Cloud, Cyber Security]
3. Testing Anti-virus Functionality of Google Drive (2022-May-20) [Tags: Cloud, Cyber Security]

C3: Cloud Miscellaneous

1. Basic Q-and-A surrounding Kubernetes technology
2. What is a service mesh?
3. Creating a dummy database and collection in MongoDB Cloud and reading the dummy document using PyMongo [Tags: Cloud, Databases, Python]

Cyber Security

CS1: Miscellaneous

1. Best Practices for Creating a Password
2. SMS Phishing is Here
3. Vulnerability, Threat and Risk (in Information Technology)
4. Revoking a GitHub session [Tags: Cyber Security, GitHub]
5. GitHub's Security Log Feature [Tags: Cyber Security, GitHub]
6. GitHub account recovery options if you are locked out from MFA [Tags: Cyber Security, GitHub]
7. Checking software traces on Windows 10
8. Additional Security Settings on Facebook (Mar 2021)
9. Polymorphism in Google Drive and Google Chrome (wrt Handling an Exe File) [Tags: Cloud, Cyber Security]
10. Limitations LinkedIn puts on you when you add too many people (2022-May-17)
11. DMCA Violations by survival8 (Apr 2022)
12. Full Lumen Complaint Notice from TIME Institute against survival8 Blog for CAT Preparation Content
13. What is this l.facebook.com in Blogger Top Referrers (2022-May-23) [Tags: Cyber Security, Web Development]
14. Accessing Twitter API From Two Systems. One With Firewall and Second Without Firewall [Tags: Cyber Security, Natural Language Processing]

CS2: Multi-Factor Authentication

1. Microsoft Outlook's MFA Setup
2. Google's Security Features for Google Account Users
3. YahooMail's MFA (Multifactor Authentication) Settings [Dated: Mar 2021]
4. Facebook's MFA Settings
5. LinkedIn Security Settings and MFA (Mar 2021)
6. Twitter Security Settings and MFA (Mar 2021)
7. Activating MFA on Heroku (May 2021) [Tags: Cloud, Cyber Security]
8. Activating MFA on GitHub and also PAT [May 2021] [Tags: Cloud, Cyber Security, GitHub]
9. Multifactor Authentication protects you from scrapers and automation tools (Case study of LinkedIn)

CS3: Torrent, Magnet Links and Tor Browser

1. Want a virus, here's one (Ref # Microsoft Security Intelligence)
2. Tor Browser, Anonymity and Your IP Address
3. Censorship in India, Torrenting and Tor Browser
4. Censorship in India, Torrenting and Tribler (Aug 2021)
5. Before you continue to YouTube, Google uses cookies and data to... [Jul 2021] [Tags: Cyber Security, Web Development, Web Scraping]
6. Google Sites, Tor Exit Nodes and Captcha
7. SaveFrom to exit from USA (Jan 2022)

CS4: Potentially Unwanted Software

1. Want a virus, here's one (uTorrent -- Ref # Microsoft Security Intelligence)
2. Potentially Unwanted Application detected by MS Defender - JDownloader
3. Testing Anti-virus Functionality of Google Drive (2022-May-20) [Tags: Cloud, Cyber Security]

Databases

D1: Excel

1. Getting Started with Spreadsheet (MS Excel and Google Sheets)
2. Simple app demonstrating VBA, SQL like Querying and Python Package XLWings in MS Excel
3. Taking table data from Excel to SQL based database

D2: SQL

1. Basics of Database Management System (by Yaju Gupta)
2. Basics of RDBMS (Relational Database Management System)
3. Create Table Statement and Constraints (Microsoft SQL Server and Oracle DB)
4. Simple application demonstrating Spring Rest, Spring Data JPA and H2 database in Spring Boot [Tags: Databases, Web Development]
5. Creating an OLAP Star Schema using Materialized View (Oracle DB 10g)
6. MySQL Installation, Queries, ODBC Setup and Views in Alteryx
7. Hour One With SQLite Database

D3: PostgreSQL

1. Pentaho and PostgreSQL Installation on Ubuntu (2021 Oct)
2. PostgreSQL (15.1) Installation on Ubuntu (2022 Dec 13)
3. Installing PostGRE 14 Database on Windows 10
4. Setting up PostGRE SQL Database on Windows 10
5. Loading data from Pandas to PostgreSQL [Tags: Databases, Machine Learning]
6. Accessing PostgreSQL from PySpark.Pandas

D4: MongoDB

1. MongoDB and Node.js Installation on Ubuntu (Oct 2022)
2. Basic Q-and-A around MongoDB
3. Demo of file operations in GridFS and MongoDB using Python
4. Creating a dummy database and collection in MongoDB Cloud and reading the dummy document using PyMongo [Tags: Cloud, Databases, Python]
5. Node.js and MongoDB Solved Interview Problem (Oct 2022)
   I'm making 2 queries (or a single query) to the database. What I want to achieve: If one of them is null, I want to add the value 'nil'. Example: field1: nil, field2: 'value'. If both are null, then I want it to respond with the 'not found' message. What's a good approach for this?

D5: Graph Database - Neo4j

1. Getting started with Neo4j - The Graph Database
2. Basic Q&A around graph-databases
3. 10 Interview Questions on Cypher Queries and Knowledge Graph Using Neo4j (For Data Scientist Role) - Jun 2024

D6: Our Database Videos on YouTube

1. Basics of DBMS 20211225
2. SQL (Structured Query Language) Hour 1 (2022-Feb-05)
3. Create Table Statement and Constraints (2022-Feb-06)
4. SQL Operations (as, union, like, inner join, where, and, count, get, select) [2022-Feb-7]

Databricks (Big Data and Machine Learning)

1. Introduction to Big Data (by Databricks)
2. Introduction to Unified Data Analytics with Databricks
3. Fundamentals of Delta Lake (Databricks)

Deep Learning

DL1: Activation Functions

1. Activation Functions in Neural Networks
2. Choice of activation function between Sigmoid and Hyperbolic tangent, and its relation to vanishing gradients problem
3. Deep Sparse Rectifier Neural Networks (Xavier Glorot, 2011, Research Paper)

DL2: Misc

1. Types of Artificial Neural Networks and their Applications
2. Demonstrating Keras using OCR problem on MNIST data
3. Efficient Back Propagation (Yann LeCun, Research Paper, 1998)
4. Steps involved in 'training the Artificial Neural Network with Stochastic Gradient Descent', and 'Convolutional Neural Networks'
5. Distributed Deep Learning Using Python Packages Elephas, Keras, Tensorflow and PySpark [Tags: Anomaly Detection, Deep Learning, Spark]

DL3: Stock Market Price Prediction

1. Prediction of Nifty50 index (time series) using LSTM based Deep Learning model
2. Prediction of Infy stock market price using Recurrent Neural Network
3. Prediction of Infy Stock Market Price using LSTM based model

Flask

1. Create a plain HTML form and Link it to a simple Flask API to display the contents of the form
2. Hello World Example Demonstrating Python, Flask and REST API
3. Hello World App Demonstrating CORS using Flask
4. Demo for Flask CORS and AngularJS while sending and receiving data
5. Demo of Swagger OpenAPI Specs using Python
6. Creating a new endpoint in a Swagger OpenAPI application
7. Creating an HTML form on Flask server and scraping it with Scrapy [Tags: Flask, Scrapy]
8. Creating ML model, saving it, and creating Flask API [Tags: Flask, Machine Learning]
9. Deploying Flask based 'Hello World' REST API on Heroku Cloud [Tags: Cloud, Flask]
10. Flask CORS based API hosted on Heroku [Tags: Heroku, Flask]

Free and Open-Source Software

1. OK Cupid (looking into a free match-making software)
2. Tor Browser Seeking Donations
3. SaveF.net blocked in India from 2023-Jan-1 and how you can still use it via Tor Browser
4. LibreOffice for Beginners
5. Convert .mkv file to .mp4 file using VLC Media Player
6. AngularJS Saying Goodbye [Tags: FOSS, JavaScript, Web Development]
7. Zoom's self-promotion and Limitations on Free Account
8. Demo of Linear Regression on Boston Housing Data Using Weka [Tags: FOSS, Machine Learning, Weka]
9. Text to Speech APIs in different browsers for Ubuntu 21.10 [Tags: FOSS, Natural Language Processing, JavaScript]
10. DMCA Violations by survival8
11. Wikipedia asking for donation in India 2022-Jun-4
12. Install LibreOffice Today, As MS Excel Disables All Functionality For The Unlicensed Installation (2022-Jun-12)
13. Creating and Editing Line Chart in LibreOffice Calc [Tags: Data Visualization, FOSS]
14. Digging deeper into your toolbox (Viewing LDiA code of sklearn)
    [Tags: FOSS, Machine Learning, Natural Language Processing]

Gen AI + Large Language Models

1. Building Zero Shot Classifiers For Text Using Large Language Models (Such as Facebook's BART and Google's BERT)
2. Demystifying GLUE: A Benchmark for Natural Language Processing
3. Streamlining NLP Tasks: A Deep Dive into Hugging Face Transformers Pipelines
4. Setting up your first Vector Database (pgvector) - Finds Usage in LLM Apps
5. Trying some prompts, listing all models and trying embeddings model of Google's Generative AI package
6. Questions from Course 'Pair Programming With a Large Language Model'
7. How to use AI for coding the right way
8. 39 AI Code Tools - The Ultimate Guide in 2024
9. Generative AI in a nutshell (With Video + Q&A)

GitHub

G1: Individual Git Commands

1. Command 'git clone'
2. Command 'git status'
3. Command 'git merge'
4. Command 'git stash'
5. Command 'git config'
6. Command 'git reset'
7. Command 'git reset' with options 'hard' and 'soft'
8. GitHub Commits and Command 'git log'
9. Compare Two Files Using 'git diff'
10. Command 'git fetch' to check if remote is ahead of local
11. Git Error in 'git add' command wrt Long File Names

G2: Case Studies of Git Commands

1. What is GitHub
2. Starting a new GitHub project from CLI
3. Quick Setup Tips by GitHub itself
4. Getting Started with GitHub
5. Revoking a GitHub session [Tags: Cyber Security, GitHub]
6. GitHub's Security Log Feature [Tags: Cyber Security, GitHub]
7. GitHub account recovery options if you are locked out from MFA [Tags: Cyber Security, GitHub]
8. Issue with storing large files in GitHub
9. Git error with code 'err 8'
10. First time with 'Git LFS' (Git for Large Files)
11. Activating MFA on GitHub and also PAT [May 2021] [Tags: Cloud, Cyber Security, GitHub]
12. Introduction to GitHub branching in 10 commands
13. Using Git commands on Android Phone [Tags: Android, GitHub]
14. You have divergent branches and need to specify out of three options (merge, rebase, fast-forward) how to reconcile them. What to do?

Hadoop / Spark

HS1: Installation of Hadoop

1. Getting started with Hadoop on Ubuntu in VirtualBox
2. Setting up three node Hadoop cluster on Ubuntu using VirtualBox

HS2: Installation of Spark

1. Getting started with Spark on Ubuntu in VirtualBox
2. Setting up a three node Spark cluster on Ubuntu using VirtualBox (Apr 2020)
3. Basic Q-and-A surrounding Spark technology
4. Notes on setting up Spark with YARN three node cluster
5. Creating Two Node Spark Cluster With Two Worker Nodes and One Master Node Using Spark's Standalone Resource Manager on Ubuntu machines (2022 Oct 23)
6. Installing Spark on Windows (Nov 2022)

HS3: Installation of PySpark

1. Installing PySpark on Ubuntu And Basic Testing (2022 Oct 8)
2. Installing PySpark on Ubuntu And Basic Testing (2022 Dec 13)

HS4: Installation Failures

1. Spark installation on 3 RHEL based nodes cluster (Issue Resolution in Apr 2020)
2. Beginner issues while working with Hadoop and Spark (May 2020)
3. Spark Installation on Windows (2022-Oct-07, Status Failure, Part 1)
4. Spark Installation on Windows (2022-Oct-07, Status Failure, Part 2)

HS5: Applications of spark-submit

1. Launching a PySpark program on (Spark + YARN) cluster using "spark-submit"
2. spark-submit For Two Node Spark Cluster With Spark's Standalone RM For Pi Computation (2022 Oct 23)

HS6: Distributed Deep Learning

1. Installation of Elephas (for distributed deep learning) on Ubuntu through archives (Apr 2020) [Tags: Hadoop / Spark, Machine Learning]
2. Distributed Deep Learning Using Python Packages Elephas, Keras, Tensorflow and PySpark [Tags: Anomaly Detection, Deep Learning, Spark]

HS7: Resilient Distributed Dataset (RDD)

1. What is an RDD in PySpark?
2. Demonstrating count(), take() and collect() for printing contents of a PySpark RDD
3. Transformations in PySpark, two types of transformations and an example of flatMap method
4. PySpark's reduceByKey Method, Word count and Line count Programs
5. Counting and filtering blank lines from input file in PySpark
6. A Solved Exercise in RDD Filter and Join Operations (Interview Preparation)
7. Broadcasting variables to nodes to reduce data shuffling from RDD joins
8. 5 Questions on PySpark Technology

HS8: Ways in which Pandas API on PySpark differs from Plain Pandas

1. Way 1: In Reading null and NA values
2. Way 2: Difference in how access to str representation is provided
3. Way 3: How isin() works for Plain Pandas and how we have to use to_numpy() for it in PySpark's Pandas API
4. Way 4: With respect to DataFrame.replace() Method
5. Way 5: WRT Cell Value Replacement Through Assignment

HS9: Basic tasks done using all the three: RDD, SQL DataFrame, and PySpark.Pandas DataFrame

1. Four Ways to Read a CSV in PySpark (v3.3.0)
2. Printing contents of RDD, SQL DataFrame, and PySpark.Pandas DataFrame
3. Data Filtering in PySpark Using RDD, SQL DataFrame and Pandas On PySpark
4. Grouping Data using RDD, SQL DataFrame and PySpark.Pandas
5. Joins in PySpark using RDD, SQL DataFrame and PySpark.Pandas

HS10: Use Cases

1. Big Data Analytics & Business (By Yajuvendra Gupta)
2. Working with HDFS (ls, mkdir, copyFromLocal, rm)
3. kNN classification parallelized using MapReduce [Tags: Hadoop / Spark, Machine Learning]
4. Demostrating PySpark's mapPartitions() using Pi calculation and Avg calculation
5. Spark SQL in Images
6. Web Scraping using PySpark (standalone mode) and BeautifulSoup [Tags: BeautifulSoup, Spark]
7. Web Scraping using PySpark (with 3 nodes) and BeautifulSoup [Tags: BeautifulSoup, Spark]
8. Comparing StringIndexer (PySpark), LabelEncoder (skLearn), OrdinalEncoder (skLearn), OrdinalEncoder (category_encoders) [Tags: Machine Learning, Spark]
9. Effect of PySpark's StringIndexer on clustering of data [Tags: Machine Learning, Spark]
10. Importance of posing right question for machine learning, data analysis and data preprocessing [Tags: Machine Learning, Spark]

Mathematical Foundations for Data Science

1. Types of Triangles
2. Number lines for natural nums, whole nums and Integers
3. Chinese way of multiplying and Japanese way multiplying together
4. BODMAS - Step by Step Working (Grade 6A)
5. Vectors Intro (4 Practice Questions, Jun 2022)
6. Vectors Introduction Quiz (Jun 2022)
7. Scalar Multiplication (MFDS)
8. Scalar Multiplication and Unit Vector Questions
9. Add Vectors (4 Questions) 2022-May-26
10. Add Vectors (7 Questions, 2022-May-28)
11. Add vectors - magnitude & direction to component (4 Questions with solutions, 2022-May-29)
12. Google offers practice problems on various math concepts from various tutoring websites (Dot Product)
13. 2 X 2 Idempotent matrix
14. Singular Value Decomposition (SVD) Overview
15. Singular Value Decomposition (Mathematical Overview)
16. Questions on The Concept of Random Variables From Statistics and Probability (From Khan Academy)

NumPy

1. Indexing in NumPy
2. Commonly used function in NumPy
3. Two Types of Matrix Multiplication Using NumPy
4. Dot Product using Python, NumPy, Matplotlib
5. Using NumPy's 'random' package (randint and shuffle)
6. Binomial Probability Distribution (application of numpy.random, and visualization using Seaborn) [Tags: Machine Learning, NumPy]
7. Factorial, NumPy and DocTest
8. Factorial, NumPy and UnitTest
9. np.meshgrid()
   • What does np.meshgrid() do?
   • Interview Problem on NumPy meshgrid() function and vstack() function - Create this array of numbers using Python code

Natural Language Processing

NLP1: Extracting Text

1. Convert MS Word files into PDF format using Python on Windows
2. Extracting Text from Docx, Doc and Pdf files Using Python
3. Getting Wikipedia data as text [Tags: Python, Machine Learning]

NLP2: Word Embeddings

• Word Counting
  
  1. Document Parsing, Document based Embeddings and Word Embeddings
  2. Math With Words (Term Frequency, IDF, TF-IDF, Cosine Similarity, LDA)
• Word2Vec
  
  1. Reasoning With Word Vectors (Word2Vec, GloVe, fastText and Doc2Vec)
  2. 'Continuous Bag of Words' Model For Getting Word Embeddings
  3. Exploring Word2Vec to find closest technologies using Wikipedia
• BERT (Bidirectional Encoder Representations from Transformers)
  
  1. Getting started with word embedding technique 'BERT' (Demo of BERT-as-a-Service)
  2. Word embeddings using BERT (Demo of BERT-as-a-Service showing installation via YAML file using Conda)
  3. Word Embeddings using BERT and testing using Word Analogies, Nearest Words, 1D Spectrum
  4. BERT is aware of the context of a word in a sentence [Tags: 'Word Embeddings', 'Sentence Embeddings', 'BERT']
  5. Maximum input length test for BertTokenizer
     Max no. of tokens in a sequence that BERT can handle is 512.
  6. RuntimeError for input token sequence longer than 512 tokens for BERT
  7. DistilBERT based Sentence Encoding Transformer
  8. Performance testing of BERT based Sentence Transformers for sentence encoding

NLP3: Named Entity Recognition

1. Python code to create Annotations required by a custom SpaCy NER
2. Creating custom NER using SpaCy for Programming Languages

NLP4: Chatbot Development Using Python

1. Chatbot Examples in Use in Different Business Domains
2. Hello World Chatbot Using Rasa
3. Getting utterances for FAQ type chatbot using Edge, Selenium and Quillbot webapp [Tags: NLP, Web Scraping]
4. Session 1 on 'Understanding, Analyzing and Generating Text' wrt a Chatbot
5. The RulePolicy of Rasa (Oct 2022)

NLP5: Sentiment Analysis

1. 6 Labeled Datasets For Sentiment Analysis
2. VADER: Rule Based Approach to Sentiment Analysis
3. Sentiment Analysis Using RNN with BOW indexing of words
4. Sentiment Analysis using BERT, DistilBERT and ALBERT
   
   • 2020 Sep
   • 2022 Sep
5. Sentiment Analysis Testing on Some Difficult Sentences

NLP6: Topic Modeling

1. Latent Dirichlet Allocation (Algorithm for Topic Modeling of Text Data)
2. Topic Modeling for BBC News Articles (Labeled Data)
   Part 1: Using Latent Dirichlet Allocation for topic modeling
3. Part 2: Using POS Tagging as word filter with Latent Dirichlet Allocation
4. Part 3: Topic modeling using Latent Dirichlet Allocation from sklearn and visualization using pyLDAvis
   [Tags: Data Visualization, Natural Language Processing]
5. Digging deeper into your toolbox (Viewing LDiA code of sklearn)
   [Tags: FOSS, Machine Learning, Natural Language Processing]

NLP7: Taxonomy Generation for English Language News Articles

Creating a Taxonomy for BBC News Articles

1. Part 1: Baseline Attempt
2. Part 2: Cheating a little bit by looking at the data set.
3. Part 3: Seeing why there many-to-many mapping between Cluster Labels and Article Categories.
4. Part 4: Referring Research Papers
   • Efficient Estimation of Word Representations in Vector Space (Word2Vec)
   • A Hybrid Approach to Hypernym Discovery S18-1116
   • Automatic Taxonomy Classification by Pretrained Language Model
5. Part 5 based on research paper using Cosine Distance: A Hybrid Approach to Hypernym Discovery
6. Part 6 based on: A Hybrid Approach to Hypernym Discovery
   In Part 5, we were using Cosine Distance between input text and output label.
   In Part 6, we are first finding the dot product and then getting a probability using the sigmoid function similar to Logistic Regression.
7. Part 7: Labeled Data for Taxonomy of News Articles from IPTC

NLP8: Social Analysis (SOAN) based on Whatsapp data

1. Social Analysis (SOAN) based on Whatsapp data (Project Setup)
   Dated: October 5, 2022
2. Social Analysis (SOAN) of WhatsApp Chats (an NLP and Pandas application)
   Dated: Jan 2020
3. Social Analysis (SOAN using Python 3) Report [Tags: Data Visualization, NLP]
   Dated: 21 Apr 2020

NLP9: Bot detection on Twitter (Jul 2022)

1. Using Sentiment to Detect Bots on Twitter Are Humans more Opinionated than Bots (Dickerson, Jul 2022)
2. Classification of Twitter Accounts into Automated Agents and Human Users (Zafar Gilani, Jul 2022)
3. Accessing Twitter API From Two Systems. One With Firewall and Second Without Firewall [Tags: Cyber Security, Natural Language Processing]
4. Using Twitter API to fetch trending topics, tweets and users posting them
5. Baseline Model For Bot Detection on Twitter Using VADER and RandomForestClassifier
6. BERT Embedding Based Model For Bot Detection on Twitter (Sep 2022)

NLP10: Machine Translation

1. Environment Setup For Machine Translation (from Hinglish to English)
2. Hinglish to English Machine Translation Using Transformers

NLP11: Text Summarization

1. Text Summarization (Project Setup)
2. Summary of Biography of Elon Musk (Fixing Mistakes of Pegasus using ChatGPT)

NLP12: Other Projects

1. Recociling two documents with transactional data (Automated Account Reconciliation Method. Patent: Chew US8639596)
2. A Dynamic Strategy Coach for Effective Negotiation (a Natural Language Processing application) 2019-Sep-30

NLP13: Challenges and Application in NLP

1. Sentences that show Natural Language Processing of English is hard
2. Types of Ambiguities in Natural Language (English)
3. Natural Language Processing (Interesting Challenges)
   Source: Natural Language Toolkit (NLTK) (Book by Steven Bird)

Source: NLP in Action: Understanding, analyzing, and generating text with Python (2019, By: H Lane, H Hapke, C Howard)

1. Stemming (An Natural Language Processing Challenge)
   
2. Semantic Analysis of Words and Sentences in Natural Language Processing
   
3. Practical applications of Natural Language Processing
   

NLP14: Activities That Are Common to NLP Pipelines

1. Normalizing your vocabulary (lexicon) for NLP application
2. Stop Words Removal (NLTK, SpaCy, Gensim)
3. Lemmatization using NLTK's WordNetLemmatizer

NLP15: Questions

1. Infosys Certified Natural Language Processing Professional (Cheat Sheet / Jun 2022)
2. Natural Language Processing Questions and Answers (Set 1 of 11 Ques)
3. Natural Language Processing Questions and Answers (Set 2 of 8 Ques)
4. NLP Questions and Answers (Set 3 of 6 Questions)
5. Natural Language Processing Questions and Answers (Set 4 of 7 Questions)
6. Infosys Certified Expert - Natural Language Processing Professional (Jul 2022)
7. Machine Translation (NLP) Quiz of 12 Questions

NLP16: Misc

1. Natural Language Toolkit (NLTK) - Highlights (Book by Steven Bird) [Tags: Natural Language Processing, Python]
2. Characteristics of NLTK, SpaCy, CoreNLP and Spark NLP
3. There are literally infinite number of words! (Heap's Law in Text Mining)
4. Using Snorkel, SpaCy to augment text data
5. Text to Speech APIs in different browsers for Ubuntu 21.10 [Tags: FOSS, Natural Language Processing, JavaScript]
6. Python Packages Useful For Natural Language Processing (Oct 2022) [Tags: Natural Language Processing, Technology Listing]

NLP17: Our NLP Videos on YouTube

1. Session 1 on 'Understanding, Analyzing and Generating Text'
2. Session 2 - Normalizing Vocabulary and Intro to Sentiment Analysis package VADER
3. Session 3 - Document Parsing, Document based Embeddings and Word Embeddings
4. Session 4 - Math With Words (2022 Jan 08)

Python

P1: TensorFlow Installation

1. Setting Up TensorFlow Using Archives
2. Installing TensorFlow and setting up the kernel for Jupyter Notebook
3. TensorFlow 2.1.0 Installation (Issues and Fixes)
4. Installing TensorFlow 2.0.1 on Windows 10 in Anaconda Prompt
5. Failing Installation of TensorFlow (2.3.0-cp37) on Windows 10 in Anaconda Prompt
6. Differences between Conda and Pip installation. Installing TensorFlow 2.1.0 using Conda on Windows 10 And 'Hello World' program.
7. Using Conda to install and manage packages through YAML file and installing kernel

P2: Rasa Chatbot API Installation

1. Installing Rasa and Spacy (alongside Anaconda)
2. Installing RASA using YML File in Anaconda [Tags: Python, Natural Language Processing]
3. % Issues in RASA CLI installation in Conda Env using YML file (and workarounds) [Tags: Python, Natural Language Processing]
   % With Less Logs
4. Installing Rasa 3.2.8 on Ubuntu using Conda

P3: Python Shell (or CLI)

1. Removing .pyc files from under current directory (Python CLI)
2. Collecting wheel (.WHL) files from the Pip Cache using Python CLI
3. Python CLI to copy contents of all the files in the current directory
4. Converting image to text, saving to disk, reading text from disk and displaying image
5. Working with log files in Bash shell [Tags: Bash Shell, Python]

P4: Package Installation and Environment Management

1. Pip, what is that?
2. Python Package for Outlier Detection PyOD Setup (Apr 2020)
3. A case of cyclic dependencies between PyPI packages [Tags: 'Machine Learning', Python]
4. Compare pip and conda installations [Tags: 'Anaconda', 'Python Package Installation and Environment Management']
5. pip's dependency resolver and dependency conflicts, also logs from pipdeptree
6. Steps toward: virtualenv, jupyter notebook, jupyterlab, ipykernel, SpaCy model (en_core_web)
7. • Installing Python Package 'transformers' for BERT
   • Alternate env.yml file for installing Python Package 'transformers' for BERT
8. Creating environment and kernel for sentence_transformers

P5: Live Python Sessions

1. Python (1) (virtualenv and condaenv) [20210516]
2. Python (2) String and related packages [20210523]
3. Python (3) RegEx in Python [20210606]
4. Python (4) Exception Handling [20210613]

P6: Solved Interview Problems on Python

1. Python Quiz (13 Questions, May 2023)
2. Compare two dictionaries in Python
3. Check in Python if a key is present in a JSON object
4. Python Interview Questions (2022 Oct, Week 3)

P7: Miscellaneous

1. Python - 10 Tips and Tricks (Set 1)
2. Python - Tips and Tricks (Set 2)
3. Creating a Windows service using Python, PyInstaller and NSSM
4. Getting Wikipedia data as text [Tags: 'Python', 'Machine Learning']
5. Set up Google OAuth 2.0 Authentication For Blogger and Retrieve Blog Posts via Blogger API (v3) [Tags: Cloud, Python, Web Development]
6. Extracting Information From Search Engines [Tags: Machine Learning, Python]
7. Working with compiled Python code (.pyc file)
8. Sending emails using Python
9. Creating a dummy database and collection in MongoDB Cloud and reading the dummy document using PyMongo [Tags: Cloud, Databases, Python]

P8: Our Python Videos on YouTube

1. Session 1 - Python: (virtualenv and condaenv) [20210516]
2. Session 2 - GitHub Intro [20210523]
3. Session 3 - Conda Environment, String and List [20210530]
4. Session 4 - RegEx in Python [20210605]
5. Session 5 - Part 1/2 - Exception Handling in Python [20210613]
6. Session 5 - Part 2 of 2 - Exception Handling in Python [20210613]
7. Session 6: Inheritance in Python (OOP Part 1) 20210908
8. Session 7: NumPy Part 1 (Array Multiplication and random package) - 2021-Sep-20
9. Session 8: Testing in Python

Snorkel (Weak Supervision Based ML)

1. Using Snorkel, SpaCy to augment text data
2. Snorkel's Analysis Package Overview (v0.9.6, Sep 2020)
3. Improving a Classifier (ML) Using Snorkel's Slicing Technique
4. Using Snorkel to create test data and classifying using Scikit-Learn

Testing Automation Using Selenium (Python)

1. Testing of Math App 'LCM of Two Numbers'

Technology Listings

1. Omocron Technology Listing (Jan 2020)
2. Technology listing related to Java based full stack development (Jan 2020)
3. Technology Listing (Week 3, Jan 2020)
4. Technology Listing (Week 4, Jan 2020)
5. Technology Listing (Week 1, Feb 2020)
6. Technology Listing for CI-CD Implementation (Week 2, Feb 2020)
7. Technology Listing Related to Operating Systems (May 2020)
8. Technology Listing related to Deep Learning (Jun 2020)
9. Technology Listing related to Android (Jul 2020)
10. Technology Listing related to web application security (Aug 2020)
11. DevOps Roadmap and Technology Listing (Infographic) (Oct 2020)
12. Technology Listing Related to Ubuntu Software House (Sep 2022)
13. Python Packages Useful For Natural Language Processing (Oct 2022) [Tags: Natural Language Processing, Technology Listing]

Linux / Ubuntu / VirtualBox / RHEL / Termux

1. Demonstrating the "File Manager" feature in VirtualBox
2. Setting up Anaconda on Ubuntu in VirtualBox
3. Demonstrating "Shared Folder" feature for guest OS Ubuntu (host OS Windows 10) in VirtualBox
4. Install and Set Up kubectl on RHEL
5. Installing and Configuring Java on Ubuntu (version 19)
6. Failing to launch Android Virtual Device on Ubuntu in VirtualBox on Windows 10 [Tags: Flutter, VirtualBox]
7. Working with log files in Bash shell [Tags: Bash Shell, Python]
8. Creating new text file from terminal on Windows and Ubuntu [Tags: Ubuntu, Windows CMD]
9. Connect Windows Machine and Ubuntu Machine Over Airtel Hotspot

U1: SSH

1. SSH Setup on Two Ubuntu Machines
2. SSH setup on an Ubuntu-based two-node master-slave network
3. Debugging SSH Setup for two RHEL systems
4. SSH Setup (on two Ubuntu machines), Error Messages and Resolution
5. SSH Setup For Accessing Ubuntu From Windows Using SFTP

U2: Ubuntu

1. Ten Commands For Day 1 With Ubuntu
2. ls - command to list computer files in Unix
3. No voice in Firefox on Ubuntu 2022-Feb-23 [Tags: FOSS, JavaScript, Ubuntu]
4. Starting with GIMP (Image Editor) on Ubuntu
5. Identifying 'Who Am I' on Ubuntu
6. Know Your Linux Hardware Using inxi

Web Development

WD1: Web Development (JavaScript)

1. JavaScript Intro (Dev Console, Data Types and Operators)
2. Browser detection in JavaScript
3. 12 'ECMAScript 6' Tips (Sep 2020)
4. Web Security: Prevent Website from opening in an IFrame
5. Debugger statement in JavaScript
6. 'Microsoft Visual Studio Code' Shortcuts
7. Before you continue to YouTube, Google uses cookies and data to... [Jul 2021] [Tags: Cyber Security, Web Development, Web Scraping]
8. English Questionnaire Application (Level Earth, Hour 4)
9. AngularJS Saying Goodbye [Tags: FOSS, JavaScript, Web Development]
10. Text to Speech using JavaScript in Firefox and Chrome (Feb 2022)
11. No voice in Firefox on Ubuntu 2022-Feb-23 [Tags: FOSS, JavaScript, Ubuntu]
12. Text to Speech APIs in different browsers for Ubuntu 21.10 [Tags: FOSS, Natural Language Processing, JavaScript]
13. Ad-Serving Limit Applied Second Time (Mar 2022) [Tags: Web Development, Web Scraping]
14. JavaScript RegEx Solved Interview Problem (Oct 2022)
15. 20 Quiz Questions For JavaScript Beginners with Easy Difficulty (Oct 2023)
16. Learning JavaScript as a Second Language
    • Learning JavaScript as a Second Language (Lesson 1)
    • Lesson 2 (Data Types in JavaScript)
    • Brief Intro to Functions in JavaScript (Lesson 3)

WD2: Web Development (using Java)

1. iMAS 101 (XML (and Java) based framework for web-development)
2. Hello World Application on JBoss
3. Hello World Application in Spring MVC framework Using Technologies Maven (build tool), Eclipse (IDE) and JBoss (server)
4. Debugging a Spring MVC application in standalone JBoss using Eclipse IDE
5. Spring Framework - Inversion Of Control - Basic Example
6. Hello World application demonstrating REST API and Spring Boot
7. Spring Boot vs Spring MVC vs Spring
8. Simple application demonstrating Spring Rest, Spring Data JPA and H2 database in Spring Boot [Tags: Databases, Web Development]
9. Download JAR (Java Archives) files
10. Omocron Webportal Setup (Jan 2020)

WD3: Web Development (Python)

1. Set up Google OAuth 2.0 Authentication For Blogger and Retrieve Blog Posts via Blogger API (v3) [Tags: Cloud, Python, Web Development]
2. HTTP Error Codes and REST APIs [Tags: Python, Web Development, Web Scraping]
3. URL Redirection:
   What is this l.facebook.com in Blogger Top Referrers (2022-May-23) [Tags: Cyber Security, Web Development]

WD4: Web Development (KnockoutJS)

1. Knockout based Counter Version 1
2. Knockout based Counter Version 2
3. Knockout based Counter Version 3
4. Knockout based Counter Version 4 (Erroneous)
5. Knockout based Counter Version 5 (Erroneous)

WD5: HTML

1. LinkedIn's HTML Assessment Dump (Mar 2023)

Web Scraping

WS1: Scrapy

1. Getting Started with Scrapy
2. Creation of new directories and files by commands 'scrapy startproject' and 'scrapy genspider'
3. Creating a Flask API for the Scrapy and dumping the parsed content into a JSON file
4. Scrapy (Python package for web scraping) Q&A (Dec 2019)
5. Recursive scraping with depth two using Scrapy
6. Scrapy spiders for getting data about programming languages from Wikipedia
7. Creating a Flask API for Scrapy that creates custom Spiders for every request
8. Scrapy spider to retrieve URLs from any webpage URL passed by Flask API
9. Generating Scrapy Error 'ValueError - signal only works in main thread'
10. Comparing Scrapy Logs for the cases of Success and Failure for Wikipedia
11. Demonstrating proxy authorization for a Scrapy spider through middleware and custom settings
12. Creating an HTML form on Flask server and scraping it with Scrapy [Tags: 'Flask', 'Scrapy']
13. Scrapy Q&A (Mar 2020)

WS2: BeautifulSoup

1. Web Scraping using PySpark (standalone mode) and BeautifulSoup [Tags: BeautifulSoup, Spark]
2. Web Scraping using PySpark (with 3 nodes) and BeautifulSoup [Tags: BeautifulSoup, Spark]

WS3: Selenium

1. Starting With Selenium's Python Package (Installation and Novice Errors)
2. Resolving Selenium error for WebDriver and Chrome Browser version mismatch (Jan 2023)
3. Getting utterances for FAQ type chatbot using Edge, Selenium and Quillbot webapp [Tags: NLP, Web Scraping]
4. Ad-Serving Limit Applied Second Time (Mar 2022) [Tags: Web Development, Web Scraping]

WS4: Requests

1. Requests.get method, cleaning html and writing output to text file
2. Getting a Web Server's Response Header Using Python
3. HTTP Error Codes and REST APIs [Tags: Python, Web Development, Web Scraping]
4. Before you continue to YouTube, Google uses cookies and data to... [Jul 2021] [Tags: Cyber Security, Web Development, Web Scraping]

Windows CMD

1. Windows Cmd Tip - Handling files with long names
2. Windows Cmd Tip - Findstr (A grep for Windows)
3. Windows Cmd Tips (Jan 2020)
4. Resolving errors 2502 and 2503 while installing software on Windows 10 by the help of Windows CMD
5. Hide a file behind an image using Windows CMD
6. Working with 'dir' command on Windows CMD prompt
7. Working with base-64 encoding using Windows CMD
8. Connecting two PCs to form a network using Ethernet (RJ45) cable
9. Creating new text file from terminal on Windows and Ubuntu [Tags: Ubuntu, Windows CMD]
10. Managing tasks on Windows using CMD

Certificates, Rewards and Recognitions

1. Power Seminar organized by ICT Academy, Ram Lal Anand College and SkyCampus (2021-Feb-19)
2. Certification for Webinar from Dayanand Sagar University, Bengaluru (2022-Apr-9)
3. Certificate for Webinar on Career Road-Map for AI & Data Science at Global Institute of Technology, Jaipur (2021-Jul-24)
4. Infosys Certifications
5. Infosys Rewards and Recognition