- wanted a basic share analyser script/program for the ASX (it can obviously be used for a lot of other stuff including general purposes statistical analysis provided you know how to code). Built the following:
- description is as follows:
# I wanted a simple, basic ASX share analyser for files from:
# https://www.asxhistoricaldata.com/archive/
# https://www.asxhistoricaldata.com/
# This script does only simple statistical analysis and should only be used
# for a small set of files. Processing over a period of years of ASX history
# can take hours of processing on a mid range computer. Ideal situation is
# for things to be done via suitable backend such as a Database or Big Data
# solution.
#
# As this is the very first version of the program it may be VERY buggy.
# Please test prior to deployment in a production environment.
- the following is an account of some other research I did for this
shell script series of numbers statistics
r read from stdin
r mean of numbers linux cli
r mean of numbers linux cli
- the core of it relies on statistics. If you want to know more about statistics then there are lots of free courses you can try
statistics free certificate
probability tutorial
data science certification free
data scientist certificate short course free
rapidminer certification
free nosql certification
- I looked at some of the following tools
sudo apt-get install ministat xplot xplot-xplot.org weka weka-doc
- trying to find correlations between data points?
linux cli spot correlations between columns
- if you are interested in financial analysis you may be interested in the following as well:
Random Stuff:
- as usual thanks to all of the individuals and groups who purchase and use my goods and services
- latest in science and technology
https://phys.org/news/2019-11-machine-learning-assisted-molecular-high-performance-photovoltaic.html
- latest in finance and politics
Journalists anonymously share earnings in viral movement to end pay 'taboo'
https://www.smh.com.au/world/europe/is-the-world-entering-the-age-of-forgetting-20191111-p539em.html
- latest in defense and intelligence
- latest in animal news
- latest in music and entertainment
Random Quotes:
- The Human Genome Project was a vast long-running and internationally collaborative project to determine the sequence of nucleotide base pairs that make up human DNA, and identify and map all the genes of the human genome, both physically and functionally. In fact, it is the world’s largest collaborative biological project across all of history.
However, it’s massive. Who’d have thought humans are so complex? With a genome of seven billion DNA base pairs, it takes 100GB to store the unique genetic sequence for any individual human being as a string of text using the letters A, T, C and G that refer to the bases – adenine, thymine, cytosine and guanine.
Researchers have already dealt with the issues of collecting and storing genome data, but actually analysing the data — to understand and identify disease markers and explore the difference between healthy and cancerous cells — has previously been a slow and complex affair. Specialised high-performance computing hardware has been employed, but with a high cost to buy, researchers are queuing up to use the small numbers they have.
The Australian National University turned to the cloud, working with Microsoft partner BizData, and found it’s taken away the administrative overhead of managing HPC devices, and more importantly, it’s also accelerating research with more computing power at lower costs.
ANU’s Department of Genome Science had access to 30-40 local servers and a number of shared HPC environments. The researchers had workstations armed with 16 cores, 10TB storage and 128GB RAM. Originally, the cloud was viewed as a way of giving temporary boosts in power during peak demand, charged by usage, instead of having to buy another HPC server.
However, while the cost reduction — a quarter of that of managing their own hardware — was expected, ANU also found they received four times the computational power they had on-premise for that cost.
- Less than a year after they launched the world’s only quantum communications satellite, Chinese researchers have for the first time ever sent entangled photons from space to ground stations on Earth.
“This is the first step towards worldwide secure quantum communications, and maybe even a quantum internet,” says Anton Zeilinger, an expert on quantum physics at the University of Vienna in Austria.
One of the building blocks of a secure quantum network is the ability to exchange entangled photons between two parties. When a pair of photons are entangled particles, measuring one instantly influences the state of the other, regardless of the distance between them.
To create a cryptographic key, the two parties, say Alice and Bob, use the results of a series of measurements on pairs of entangled photons. The key can then be used to encrypt messages that are sent over a regular channel. The duo can also detect the presence of an intruder who tries to intercept and retransmit the entangled photons, because doing this destroys the entanglement.
Last year, researchers in China established a record separation between Alice and Bob: entangled photons were exchanged over a distance of 404 kilometres using non-commercial, high-quality optical fibre.
Entangled light
Now, entanglement has been preserved in pairs of photons sent by the Chinese satellite Micius to ground stations separated by 1203 kilometres — a new record.
“It took us almost 14 years to manage this achievement,” says Jian-Wei Pan of the University of Science and Technology of China in Hefei.
They first had to ensure that their source of entangled photons would survive the rigours of a launch and that the entangled photons wouldn’t be destroyed while traveling through about 10 kilometres of lower atmosphere, which is thick and turbulent. After successful ground-based tests of these technologies, such as using small telescopes to focus the photons to distant receivers, in August 2016 China launched Micius into orbit at an altitude of about 500 kilometres so it would take the same path over China at the same time each night.
The next challenge was for ground stations to track the fast-moving satellite, and establish optical links to receive entangled photons. Three optical telescopes in Delingha in Tibet, and Lijiang and Nanshan in north-west China locked on to the satellite, which appeared briefly overhead once every night.
The ground stations used adaptive optics — which is technology that can measure the turbulence of Earth’s atmosphere in real time and cancel out its blurring effects. They also used technology to filter out moonlight and light pollution from cities, to reduce the noise in the optical link to the satellite.
For every pass of the satellite over China, which happened at night for about 275 seconds, it had to establish two such downlinks simultaneously, either between Delingha and Lijiang (1203 kilometres apart) or Delingha and Nanshan (1120 kilometres apart).
If we were to use optical fibres to distribute pairs of entangled photon pairs on Earth over 1200 kilometres, the loss of signal strength with distance means that we could only transmit one pair per second.
The Chinese satellite smashed that barrier. “We have already improved the distribution efficiency by 12 orders of magnitude over former technologies,” says Pan.
Next up, daytime
Zeilinger is impressed. “It’s a very important achievement,” he says. “It proves that China is really able to master the technology, particularly the technology to follow a satellite optically and have the downlinks.”
Pan says that the next step is to operate during the daytime, which means coping with far more light pollution from the sun, which can destroy the entanglement, and also to send satellites into higher orbits so that they are visible for longer durations. “Then it will be really a useful and radical system for secure quantum communications,” says Pan.
The team also tested the fundamentals of quantum mechanics. Einstein had argued that since quantum mechanics allows for entanglement, which he derided as “spooky action at a distance”, it must be an incomplete theory and that there must be an underlying reality to explain such weirdness. But the tests done on the entangled photons between the pairs of ground stations showed that quantum weirdness is real and cannot be explained by any Einsteinian notions of hidden reality.
- America is the world’s largest producer of natural gas and is on track to become the dominant exporter of LNG, thanks in part to soaring demand from South America and Asia. But the big problem with its LNG, as far as European buyers are concerned, is that it is more expensive than pipelined gas from Russia. American LNG exporters need to sell in Europe for at least $6-7 per million British thermal units (mBTU) to cover the costs of freezing, shipping and re-gasification. By contrast Russia’s long-run marginal cost of supply to Europe is only about $5 per mBTU. American LNG is also more expensive than LNG from Qatar and some African countries because feed gas in America is more costly to extract, and the distances it has to travel to the customer are longer.
Last year, as a result, Europe imported eight times more gas by pipeline than in the form of LNG, according to the US Energy Information Administration. This trend appears to be continuing into 2018. Imports of Russian gas by countries in the European Union hit a record high in the first half of the year, up 8% year-on-year. The threat of competition from America has forced Gazprom to become more efficient and to lower prices. So American LNG is actually more likely to end up in Asia, where Australia and Qatar sell a lot of LNG but are unable to meet growing demand. China, the main driver of that growth, has become a particularly important destination. Ensuring that President Donald Trump’s trade war with China doesn’t close off this market is more important to American LNG suppliers than any deal signed in Europe.
