All about the angles
The SmartScope measures an object’s distance from a given point and in our case the object’s are mammals at sea. But why would they need to know how far away a whale or seal is from a boat?
It’s all connected to seismic shooting. Air guns are fired into the depths below and regulations state that no mammal can be within a certain range when this occurs. But to know where the mammals are you’ll need a marine mammal observer or a boat with very expensive sonar systems.
Or - if you have a software team like Equinor - you can make do with a small computer, a pair of binoculars and a gyroscope, all at a fraction of the price of the wildly expensive sonar systems. While it’s name might suggest that it functions using fancy technology only available from a space station, it’s actually quite simple - all it does is measure angles at the push of a button.
How it works
“Using the gyroscope, the SmartScope measures the angle from the horizon to the point you’re measuring together with the height from where you’re standing. Then it calculates the distance to the object you’re looking at,” Paracchini explains.
Together with Harald Wesenberg, Pier Lorenzo spent his playground activity time on the project in its early phases. They tested a Raspberry Pi computer and paired it with a gyroscope, attaching it to a pair of binoculars.
Pier talks about the early days of the SmartScope and the tech behind it all. (Video: Torstein Lund Eik)
Programming meets the physical world
“We weren’t inventing anything from scratch but taking different elements and tried to make them work together. For me, the interesting part was that everything was new and I was eager to start working on it. I had to learn Python as well as the Raspberry Pi to make it all work. The challenge was both in programming and working on a thing you could hold in your own hands,” Paracchini says.
Ultimately, they ended up using a Phidget single board computer for the first versions of the SmartScope - then known as the Durimeter.
In March of 2015 the project was handed over to Arve Skogvold, Asbjørn Alexander Fjellinghaug, Terje Barstad Olsen and Harald Wesenberg from IT SI Trondheim. They had more time available and it was changing from a proof of concept to something that they wanted to create an actual product out of. In the start the team focused on understanding what they wanted to achieve.
“It was a new concept for us so we spent some time on just wrapping our heads around the issue. We weren't meant to spend too much time on it but it was just so much fun it became our full time job,” Olsen says.
“It all felt like a DIY-project since we got so many gadgets and components to build something with. It was very exciting work and a great deal of fun to create something we could hold in our hands."
Terje Barstad Olsen
Want to stay updated on Loop?
The man behind it all
We can’t tell the story of the SmartScope without taking a walk down memory lane. The early beginnings of the idea came from Jan Durinck, a marine mammal observer in Denmark.
He knew first hand how difficult measuring distance is at sea, with more than 30 years experience behind him. He pitched the idea to Jürgen Weissenberger at TPD Equinor, who has been pushing the project forward to where it is today.
The difficulty of spotting mammals at sea lies in calculating the animals distance. When standing on a boat and scouting the horizon, you normally have nothing but waves to use as reference points to the whale or other animal you’ve spotted.
Seeing as these waves move around constantly it’s quite challenging to get a correct measurement, which leaves room for human error. You can use a laser but even this isn’t completely accurate, since you can’t be entirely sure you’re aiming at the object you want to measure.
“I approached a couple of electronics companies but there wasn’t a big enough market for it, so I thought it was a project we could promote here in Equinor. We would have to base it on an off the shelf product as there wouldn’t be a lot of money available for the project and we ended up with a Raspberry Pi.”
Breaking the ice
The feedback the team received was crucial to continue working on and improving the device. One of the lucky few who went out on an expedition was researcher Christian Collin-Hansen.
He first traveled to Quebec where boarded the icebreaker Amundsen and set sail for offshore Newfoundland and Labrador Canada. This was done with the first version of the SmartScope, which ran on a Phidget single board computer.
“The device was something Gyro Gearloose could have invented. There were wires hanging off it and small bugs here and there but we managed to solve them and the SmartScope worked exceedingly well all things considering. It was a very fun journey to be a part of,” Collin-Hansen says.
When you're on the high seas and trying to spot mammals in the distance, the SmartScope is of great help.
Breaking your way through the icy wastes outside of Newfoundland and Labrador Canada has its challenges and really put the SmartScope to the test. Collin-Hansen served as a marine mammal observer, alongside two seasoned veterans.
And with a skilled team teaching him the ways of the land - or in this case the sea - he caught on quickly. But he also had a well-prepared set of binoculars with him.
“The main goal of the trip was to see if the SmartScope could be a tool to help ease and improve the work that the observers do. We were absolutely dependent on the SmartScope being robust and user friendly - it had to be a stable system that wasn’t dependant on daily updates. We didn’t have the means to download large datasets from the boat, so this was crucial,” he says.
Collin-Hansen had tested the binoculars before embarking on the ship. Together with Jürgen Weissenberger, the man with the initial plan, he put the SmartScope to the test in the fjords outside of Trondheim.
Working with IT SI was a very positive experience for Collin-Hansen. He was impressed by their curiosity and willingness to learn, which he says was present all the way from the beginning.
“IT SI were able to create a fully functional product in a matter of weeks! It was really fun to see how it went from the early designs to an actual, physical product that we could use and that gave predictable readings with an impressive processing power.”
“We cross-checked the readings from the SmartScope with readings from the icebreaker’s sonar systems and they were very good,” Collin-Hansen adds. But everything wasn’t smooth sailing unfortunately. The single board computer was found to have a little unstable WiFi connections and IT SI recommended a switch to a Raspberry Pi, complete with integrated WiFi, and it’s still the brains of the SmartScope today.
Listen to what it's like to stand outside of a icebreaker ship travelling through the ice offshore of Newfoundland and Labrador, Canda. (Video: Torstein Lund Eik)
Finding a smarter future
Now, the SmartScope gang are helping users learn the tool, getting to know it’s functionality and building the kits. They’re currently preparing the scope for exploration, as they wanted to have a crack at it.
“It’s a very funny project as it’s very low-cost, doesn’t take much of my or the programmers time to set up but the people who use it have a better workday,” Weissenberger says.
He’s not considering it a finished project, it’s quite the contrary - he wants to push it even further. Now, they’re looking at how to put the different electronics into the housing and even implementing a voice recorder so the observer can simply tell the program what they see - and have it put into the logs.
“I would like to provide a full set, containing the binoculars, a computer and a WiFi hotspot. This would let a colleague see and access the protocol lists and logs at the same time,” Weissenberger explains.
“The next generation will be a full set, found in two suitcases. One with binoculars and one with everything else you need to make it easier to use,” he adds.
In late April of 2018, Jürgen handed over two brand new SmartScope kits to a research vessel in Illmuiden, the Netherlands. The crew were heading into Norwegian and British waters to do seismic shooting and will be using the SmartScope. Additionally, two kits have been delivered to a crew heading for an expedition in Nicaragua.
But work on the SmartScope is not done yet, and Eirik Ola Aksnes from IT SI Trondheim has stepped up to the plate and is ready to push the project even further.
“Working on a project that integrates hardware and software offer both satisfying challenges and problems to solve. We rarely get to develop physical products, so working with the Raspberry Pi, sensors and Python is simply a lot of fun!” Aksnes says.
Some of the people who have been involved with the SmartScope project:
Terje Barstad Olsen
Pier Lorenzo Paracchini
Eirik Ola Aksnes