This technical blog is my own collection of notes , articles , implementations and interpretation of referred topics in coding, programming, data analytics , data science , data warehousing , Cloud Applications and Artificial Intelligence . Feel free to explore my blog and articles for reference and downloads . Do subscribe , like , share and comment ---- Vivek Dash
Thursday, July 22, 2021
Shopping Cart Total Bill Generation Project in Python using Jupyter Notebook | Sample Mini-Project Implementation Infographic Note
Monday, June 7, 2021
Topics for Python - Basics ( Syntax , Construct , Variables , Operators , Data Structures , Decision Making statements , Loops , Functions , Object Oriented programming )
=====================
Topics for Python - Basics
=====================
1) Syntax
2)
Variables
3)
Operators
* One can explore
different mathematical operators and
calculations that can happen using
the available operators in Python
4) Data Structures
1)
Decision Making Statements
:
If , If-else , Nested If else , chained conditionals of the else if type of statements , single statement conditions all come under the category of decision-making statements . Along with earning , one may also have to practice 10+ coding problems on a daily basis which would help someone get familiar with the manner in which one can scale up on the level of complexity of the programs and their creation
2)
Loops :
Loops are the structures that repeat a sequence of instructions . Python deals with while loops , for loops and nested loops . Along with these one may also learn loop control statements which show the manner in which loops can be initialised , implemented , interjected and put to end in the desired way of the programmer .
3)
Functions in Python
We will just put a small recap over Functions in Python :
User Defined functions are those functions which a user / programmer writes himself which takes programming constructs and statements to write a function which would achieve a desired result at the end of the function which may include the use of some built-in functions into the overall function code construct .
Built-In functions are those functions which are created as a part of the programme package at the time of creation of the Program package and its default libraries which come together with the program at the beginning of the program package .
Lambda functions are also some form of user defined function , however the construct is limited to only one line and this usually does the work of iteration over the elements of the function , access the individual elements , or use the functions to iteratively append , retrieve or delete some elements over an existing structure or a dummy/temporary structure .
* Along with the the basic concepts
of the scripting part of the Python Language one also needs to have a good understanding
of implementation
as well as creation of features in Object Oriented Language features of Python
:
1)
Polymorphism
2) Inheritance
3) Encapsulation
4) Abstraction
All these aspects of Programming in Python and how the same are going to be used in Python for Data Science and Machine Learning Modelling would be
discussed in further blogs . As I am getting disarrayed due to a some intermittent problems over my laptop I am not able to implement some of the important Algorithms and Modellling Processes . But soon , I hope to get these started on a better level .
Last
modified: 21:32
Lists and Dictionaries in Python Dictionaries in Python
When should one use dictionaries and when should one use lists in Python
* Example where a List is used for data storage is an example of a shopping cart where any stored item object's storage does not matter .
* Example where a Dictionary Item object is used as a storage object is that of a an examination roll / rank number sheet ( parikhya patra ) where people are arranged on the basis of their marks obtained in some examination from Rank 1 to the last rank in the exam . Usually the person who obtains the highest marks in a given exam is attributted the 1st rank and the first roll number for that examination is also alloted to the first rank holder after the results are out , the successive role numbers are also attributed according the net marks obtained by an examiner in the considered case of the examination till the last rank/roll number of the examiner .
* A dictionary is very useful data storage object where one may need to access a given data based on the item that is present over a given index position within the storage object of the data structure .
To sum up once again for Lists and Dictionaries
* Lists are ordered data structure objects that means that the program has control over the
order in which the data is stored . This data is also sortable that means that the program can sort the data into whatever order when the data is needed to be fetched and retrieved , the list is also containing a list of iterable items i,e items that can be accessed one item at a time when the list object is iterated or
executed within a loop .
* Dictionaries are like the partially ordered data structures that
can control the order or the manner in which the data items are inserted and stored within the
object in the form of keys and attributes . Dictionaries are non-sortable
and iterable in pairs of both keys
and associated value objects .
Last
modified: 18:49
Technical Data Analyst posted at HP @Bangalore on 07-06-21 - Self Analysis , Upscaling and Recommendation
Technical Data Analyst posted at HP @Bangalore on 07-06-21
=======================================================================
* The secondary requirement for the fitting criteria is that the person should have a Master's degree in computer science or Information systems
* A candidate for the job should be able to leverage and scale open source tools .This aspect is currently I am also not sure and I am also not yet sure which open source tools are being referred to in this , since collaboration tools are the most requisite open source tools that are common to all the people albeit their technological skills
* Proficiency in Public Cloud
Providers like Amazon AWS , Google GCP , Microsoft
Azure etc is also a must { I have some experience over AWS cloud and
am aware of the manner in which some of the applications work over AWS but I am
yet to explore all the greater details and aspects of AWS and how big scale
projects are deployed at AWS }
*
Experience over Industry - standard BI platforms { this necessitates a candidate to have some good amount of experience
over working over Business Intelligence and Reporting Applications like Microsoft Power Bi and Tableau where one might be able to carry out and find out report generation and deployment
activities in order to find out the necessary actionable items required for the specific work }
* Knowledge of SAAS products and their multitenant cloud implementation { I this area I am just aware of the fundamental theorems that are under work and implementation is still yet to be done and scaled up , so this is one area that I shall again need to brush up and get my hands upon. I shall try to learn from the available online resources and try online cloud platforms over where such projects and modules are deployed}
* Analyse Sales and Financial
Data with Cloud and Operational data to present
over to the clients to view
* Data Warehousing and Reporting solutions to address the growing needs for reporting , analytics , and data requirements
Last modified: 13:31
Wednesday, March 17, 2021
Union Operation in RDBMS - Fundamental Relational Algebra Concept
Union Operation - RDBMS
Fundamental Relational Algebra Concept
=======================================
* Scenario where a Union Operation over a rdbms table could be
used : -
Consider a query to find the names of all the bank customers who
have either an account or a loan or both in a bank .
* To find the names of the customer who have an account and also
a deposit account in the bank , the search query would consider the search to
take over "depositor" relation table and the "borrower" relation
table .
* In order to find out the names of all the customers with a
loan in the bank , the query that could be used for the operation would be :
{figure-01}
The upper relational equation is a form of projection which
allows us to produce the relevant relation that returns the argument relation
specified within the parenthesis . So as we are interested in finding out the names
of the customers who have a loan account , the
relevant result would be fetched from the projection relation as
mentioned in the above statement .
* Similarly , if we want to know the names of all the customers
with an account in the bank , then it can be expressed in the following
projection equation :
{figure-02}
* Therefore , in order to find the answer to the raised question in our scenario that is discussed in the opening statement , one needs to do a "Union" operation over the two sets which is : we need all the customer names that appear in either both or two of the relations which can be found out by using the binary operation Union upon both the queries . The relevant relational equation can be represented in the given manner :
* The resulting relation for the query would result in a relation
with the relevant tuples from both the tables
* The resulting relations are sets from which duplicate values
are eliminated .
In Hindsight :
In our example , we took the union of two sets , both of which
consisted of the attribute "customer_names" values . In general , one
must ensure that unions are taken between compatible relations which would generate
the appropriate results without duplicates.
* Points to note when using a Union Operation over relational
sets :
If r is a set
and s is set , and one needs to find { r U s } , If r is a set and s is set ,
and one needs to find { r U s } , then the conditions that should satisfy and
hold for both relations
1)
The relations r and s must
be of the same type and they must have the same number of attributes
2) The domains of the ith attribute of r and ith attribute of s must be the same for all values of i . One may note that , both r and s are either database relations or temporary relations that are the result of relational algebra expressions as given in figure 1 and figure 2 of the article .